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[*n*m i ] &®*mk. ^m^rn^a, smmw^ 

mm&ifftWitii^mt. mJEE1t#IS:.RtfiiiJEiIi&E® 

im*&2] vmm-%& 

WfcE&gMfci* 

© ffim i &BK H"f 5 MSbx - * £ MfafEtS^S 
A2JU SiflB©^^^fS:»-HfllBMgt)x— 
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IBI*«-6] *Mfc3fc¥5R» ft®^&#a. iBMft^-i-to 
a#«* E*#SXlflMWt^£¥Rfc£trB«AA 
10 ^Stt. 

mmimtfrb. 

m&kttfk t&tu i»EiM»«#*£#»tt«e* 

ffFEEt§3Mte:©'>&< t t>-*f-M^©7*-^y h-e 
E*#a&tfMEWiMM^#©*J>fc< t t>-*»cia» 

bosses. 

[fit** 7 ] StrCttft'T-* ttfiWBtf fctt^fffcH-f- 
5 3 Xf* 4 »cE*&<0B&Ma3£fi<, 

©«Kafctffc*u*#isi 6 ice^cdb&m® 

i , 2 , 5xtt6 tciB^^M^^a^fio 

[If** 1 2 ] WS©B«A*#«*»5>liMft«rA*i- 

yb. 
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efts team fem*^®^<o tax *n b m&mtifflw^ 

[flt*£ 1 3 ] 3ft»PitA^fiS:^feB«4rA^t 
£X7-yy°b, 

ffllSIii^^^x y J: 9 #ki-bfc-e-j£Bfc<DB>rJ£SE 
[»#114] *g«*^5R. 3t«SE»^«. 

B**a«#K£» 

B«S^#a U iifj|EB&&3#afiBufBffi&& 

fEfg 2 B&wB&A^&tt&tfiiutElfS 1 Bte©H»A* 
±^mt. MlEB&S&Ji^iail-J: t>#&*ta-&/£Blfe£ 

1 B&OBff^^a^wS^.&tfiiiR^T- ' 
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1 B&<^£*^a~©**,&tJ^iR*x y :/£ » 
IK $ m 1 B& t Afl B& Sr^-T 5 B&-a-tfc* x 
y :/«>:, 

tWEH{*§-j** x y y t?# b ix 5 -a-^B^©fjT)tiati* 

ft^oiUA Srfi 1 5 B^tti^^J^^©^ r y y°t frh *£ Z> 

!am^m<z>7°v fv-i* • yy hv^r zie&b 

10 fro 

WIEB^A^#Si-i 9 A^SftfcH 1 B&SrS^-rs 
We* 

fcgB#»B&tf#£rffl^T. ttilEA^iB^rtWilt^ffl^ 
20 ^2<OB^i-e-^-rSB^BK#Si:S:*^i"5 

1 9 J WlBWfcAA^aa^ iSflMltfls*^ b 
coBte&Sge. 

30 agm#asrjnii-5at*3Si 9j;iiE*©H4ft*aastit. 

i-5i«#isi 7 tcfE«<7?B««ia^eo 
<DB^*aa^». 
40 tctaig»B^MS^«o 

[»*J5 2 4 ] HulBB^A^i^a^, «UIEm 1 Wfc t 
*lc-?r©«{^^#5rA^L. MfaB^^a* 5 , huIS 

BuiE»^^#t- : eei' tti 2 ©it i -a-^i-s 

* l 7 tcfB«©B&*&S3£Bo 

it«*352 5] tiwB»**#»±. 83ta, a 
2 4 \z.^m.<onm.9m.m.m. 0 

im*m 2 6 ] «filSB^^#att, 1 B^<D 
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2 4 KE«c<£>B&*&S^B= 
^-^Ett^ai:. MEBlHfcWi^fcttfctt^ ftr 

Ett«j^-*Et§#aKEt§ ztiznfyT*-* (Dtinm t 

lMX£^t£^5»^-**fiE^a^ fuEB&S 
K:E«M>W4Ma«i£1I. 

[W#JS 2 8 ] gfr^®^A*^*^H^5:A^-r 
A*J SJxfcWtfKOlSlllAA^SrW-aXttKJe-f-SW-W 

MEB*A#^*mjfe©Ei*%M*fcE*^5AA*# 

l!u!E®&A;^#l-S-^-C, ffrEK^fWftffl*^ ^ 
■ettWS axfc«2r#roB& h ffi je©E«#afcEfik $ tt 

'j«HiftaA^^y^ , i:*»fe4awi:arWKi"*-5IifiWa 

U:E*W>BiMEffi#ifc. 30 
[If #9 3 O ] M&B 2 8 icfBttOBttteS^&frX 

[tlt**3 1 ] *fc3t#3IL 3ts£&#a, sft^m# 

##a, B4feffi9#a> W<fcW-^k#«» B^IE®:# 

a. BfcE««s#EtffcB4fc**#sfc*ru hijeb& 

fcE&£*tfcJg l Blfcx-* t MEHfcAA#IB:te J: 9 
A***ifcJB2B«liS:, iiuESS 2 B&©B&A;ft3:# «• 
S.t^HuE^ 1 B&©B&A^#:#<ZV>&< 1 1>— 
i^T£-j£U l)WE«»«*«4#ai4, i!frfEB*t>*^# 
a»r *5EB^a#a J: *) » 5j tbfc^B^ §r*^-r 

— *lcE®^Hfc^ 1 S«©3f]tii^g-.©^SO ! 
g^f'^, SUE^^^c^lB^tA^B^Sr-a 
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«t-5E®*fci4^*^a-roa^^5B^tb^j^ 

x ?/ ^ b tt 5 £ i 1 1" 5 Bte*&3#8j. 
[If #9 3 3 ] tfsftJS 3 2 lcE«tf>B&*aa**fc«:0£ 

Ettrt" 5 r t i: 5 Etttttt. 
[St#JS3 4] ItA^ftt, 

»«Nfe#ttm#ai, 
B4ft***-KK£#«i:. 

fessH^ttm^at* 

«gfB«l3?^a t £ JUT*"* Z t Zft®. t -t 5 B&& 

B&*^a£> 
««i*#«ffl#at. 

!9:£«i«©igfMfc£A;*jB&fcfifi U-ca«B««** 

an**-*- 5^>^«*#a t , 

v ^fcW*^«E<DB«(cB(f)e©|E«|?SrJfEi-B«ieift#a t 
[|f#>K3 6l ®«A7J#St, 

[it ^jj 3 7 ] mmm&£&^m*mmtt$tm®izm 

4, 35 3 6 (cEftfDB^^S^eo 

[if 3 8 ] HtiEB#^^#aii0r)£©E»#aA> 
fcteWB^A* b, HuE^tfe^SrSiFES^ftXfi 

b&<ftWLb-fZ>n#iR3 4, 3 5 Xfi 3 6 KE«©B& 

[if 3 9 ] ^EB«S!ift#attflirE«-*®«©iKf 

S34, 3 5 Xfi 3 6 JdE^coB^MS^Bo 
[if #JJi 4 o ] 8trEBIfe£ft^attilifE*f*«Mifc0r 

e©«WT*ttaE»S:*i-r. t i"5lf *«3 4 , 

3 5 Xf* 3 6 (cE^OB^^ai^Bo 
[sf*«4 1 ] lKFEBfc&«l#att£&«0>Bte^- 

* »C0T^©@*- Ltf^Srf+JUO-t-5 r t t -r Si»* 

93 4. 3 5X113 6 fcE«©B^«LS^go 
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xmi*. t ntneAASfc £ (Dmfty*-*^m^%M&i$%. 

[St*34 3 ] UWB«««ia#«f4»f«©f L V^'t'- 

ffi-TS r. £ £*fcm£l-5fS*3 3 4 xii 3 6 »c|s«<d® 
[M** 4 4 ] tfHEH««*#SttWE#*1H*Xtt 

4 . 3 5 Xf4 3 6 iCffittOUHfe&S^B. 
[1**3 4 5 ] ftrfEIB«Eaa#©littaiS««*^ L ^ 

fc«MK£1-5W**3 4Xf±3 6 JcffittwpH&toSS 
Bo 

[11*34 6 ] lfflre«Wfe#8^3R«««Hfc«X 
ttlM X*JE#« SrW-T S - £ £1-3 »*3 3 5 

-^Tfu-ffi-rv:/^— H*x/HS{£©miffiA;ftiliH& 

j»*#»5w£*««£1-SIll**4 3fc|E«©W«« 

[W*34 8 ] SWElWM!l«*#ai±Sf3e©fE*«R 

J|«**5j^3r fc&W*£1-a8»*33 5»cffi^tf>il 

W*S4 9) SKUA^x-y^i. 
^fc^ttttttl^y^* 

K^)t^v L s'^'£. 

fe5^«m^f L s'^£» 

JS-f-B^m^^ y/i **«1"4 - t $r**£1-*H 
[»*35 0] Bi&A^xy:^, 

mm^mm^-y^k. 

^mfe<DM&m.&*Wt1£1rZ>mi$.WLl£* : T-y7k, 
K^EEcO&lfc&SrA^iSteKfil: LtBWfS© 

^fcW*«*©W*te0f3e©a5«l*:MS1-W«ia!*^9- y 
**«1-5 r £ trW*i-t-a«M&»!rlfe. 

[§**35i] is^A^^xyT-ts 



SK«ll^ttXfi KI;S<5^TA^B 

[!i!*35 2 ] t&IBiBiftSHft^^ s^ttlWBWHWS 
KMffi«&&#Xttliuffi«&^&*- Kfc*<S#J5!rJ£<D 
f^f^y t'v-^SSrJSi-r k 5r<ft#£1-*fli* 
349, 5 0 Xtt 5 1 ^fE«WiB«fe«ia*fe« 

[W*35 3] itrlEH««ift^yy^ , r±3f«©IEl6# 

5; k*<&'®k 1-31**34 9 . 5 0Xf4 5 1 Kffi«cO 

[!**3 5 4 ] tMEWMC**?- y :/r±*WB#**ra 
0#^fe^Srte©fe^(-^1"3 - £ 5:^m£1-3 
11*3 49. 50X14 51 ie:iE«<DllH&*n.a*fe> 

11**3 5 5 ] flMBSHfeg*;* r- y :TM:flWE*MMM* 
K3rje©«MiJ^«)*»Srllrt-wt*:»«£1-*HI*qi4 
9 > 5 0 Xfi 5 1 tc|E«copi^Ma*i£c 

11**35 6 1 msmms&k*? y-7\-mmfLV>m& 

7-9 tc@ff£©jS3> U*«*fMPl-* - £ £ 1"* 
f**3 49, 5 0 X f± 5 1 ©BMfe&S^ifc. 
[1**35 7] tulEtS^ttm^-xy^fi^feA^^^ 
£ IWEAAHfc £ * tcS^# flrlE 

»ft««S:*«>5w£Sr'»«£1-5BI*«4 9Xf±5 1 

[1**35 8] HuffiSMtfSW^y:/!*, IB*#«fc 

i[EA±Xtt«i^:£^3^Srttmi-3^«ttffi^7 L y7 p 
i£JMf1-5^££*fcigc£1-?>!9*34 9XI45 1 t^lS 

[i**3 5 9 1 mwm®m$k*7-v ^»±«ria«*«* 

u-</wX»4fe^ffiSr^ife1-3 r. £ ^#SS[£1-2)it*3 
34, 35XH36 (c|E«<DM^«iS^}!fe„ 

#^SrA^)®^f-*a LTHtllSIii^*^^S;{c:«^:-r 5 
w ^^#^£1-311*34 9XI45 0 

[ft *36 1 ] HfJfEIS^cigig^T 1 y^f4^^®«©{4 
exii-y-^ X£^3E1-5 ^t 1 y ^"Sr*1-S r t Sr^t 
-f-5W*35 0 {cfa^coM^iaSl^fe 

[ff*36 2l WIEttttttm^^y^ttltrElWfc*^ 
{dS-tJVT suffix y/l'- h^yvV®{fc<Df{JffiA;tliiH& 

h^^lBtfloWIWIIlSriaMIWlJi UTHtrffi*f*^«© 
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«fc 9 $fc$|5i»(D*^Sif£#3iiR $ iifc fc * icm 

w.mn&*»*-f* - 1 zw&t-tzmxm 5 0 icie* 

<Offlfc#L3fi#ifeo 

[gf*«6 4] «#*4 9fcGlt0>Bfe*ti9£&fr!£ 
[o 0 0 1 J 
[0 0 0 2] 

^yy^HS^iW^ X^&ft if <z>Jt$5#jflS ! i& 
o 1 . 18, pp. 13-1 8, 1 9 94¥) Sr^Ti-S 
[0 0 0 3] **W<kfc©*fc»H:*-Sv^-CiaiftSr 

miEt tea.? \z.n%m*mw ufc±-c, w*Mk& pi 

- 9 lc«<5# SrttfcU-r SUWWSfci h fix v * S 

(«*. tf . #§B¥ 6-2 5 3 1 9 7 -§-<&$8#flg) . 
[0004] A#!Sfcj&»fc4*£!S«i:te©«J*fc*fc3 

&3£lSriIi«e&Xf*iSf£8tfl?i: LT, ElTC^tft 

f kft&kteZU&oWr— fkX. %<Dm&<km& 

#i¥5-l 4 5 9 1 4*&«U 
5p5-3 3 6 3 7 4 ^¥6-3 1 9 1 3 Of 

7-222048 7-23 
0 5 5 4 ^fcRtWMSF 7-2 5 0 3 1 2 #4&WC|B 

[0 0 0 5] 4fc. H*A»b«[»0|H*S:«J9tau * 
^7-2 9 8 2 3 8-5§-<£$8l::iEgJ£*V Wfr 

WW 5- 1 1 0 9 3 6^S, »H¥6-1 6 9 4 2 5 
96&«U 6-225328 ^SSWM^S- 1 
5 4 2 5 9t^*l:Et$tlt^5. 
[0 0 0 6] 
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g'j^ic$^fcttft k <DwntL4t&* k-<omm<ommax 

[o o o 7] #$g91f}, :oi5^ai^lr»?BtfeI 

[0 0 0 8] W5- 1 4 5 9 1 4#4*$8t£fcfE«t<3 

[0 0 0 9] i|$M¥7-2 9 8 2 3 8 -f-^^|E«$tV 

[0010] #M¥ 5-110936 %-&mRXJVftM¥- 
6-225328 #^*fcIB*;S*b 5 WS, 

[0011] #Bf?¥6 - 1 6 94 2 5 -§-<k$RK|E^£*v 
[0012] ^M 5 ? 8-154259 -S^^ti:, AfeW 

[0013] roiptc, «3»Effii-ei4, m&txD&nte 

*^ LXtt*»*rAP*. 5 & if wM^PXSr g ibtfjXHfiBf^ 
[0014] *^BJfi, rcoi 5 tt&&*Mffi'tZW 
6<)i:-t-5. 

[0 0 15] *|gBjii^fc v ®^^«ffi«c^X(4ft« 
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mzmzz 4 H<omm^ * g tbftx tt* g » 5 

- £ *TTBfci-a WBB«*BXtf#ifcafet«cE«B# 
[00 16] 

Btt, bb##b, ftmiSB^a, BB«-§*!»a. 

* 3 *i,fcHB©#^# 

#gk, BB*&a#a, WMWtf*, BBEB#a, 
BBEBIIKWfctFfcBBB*#Btr*U BBBB^a 
tt A^ $ ftfcHB rt <&« >i*»B#a m J: 9 «a*«B $ H 
fc$B^©®^1f $R Sr ffl v > X ffi& F*9 to^^^fflE Srttttti" 
£tt£tt9#tttt#a£« gE«#a*fc.»±H(fcE«BtflK 
£Eft $ HfcWSPHfc i tt UJ $ tufcK#3e*!t^^5r-&^ 
-t-5-e-/£HB£j«#Bi «r*i"« r i S:BB£1-5. 
[0 0 17] CtUCcfctK fc*©W*«r£tf*9flraB 
£A2> («B) *©*©B9tt«:tttHU*:5*.-e 

B«©4fifc*rfir 5lt #ff <t 5 BBT# 3. 

* fc-g-j* $ ixfcBBfcBBBa^afcBS^S Zt\ci. 

[0 0 18] *«Wfcfll*W»«5MS«t4. IMfc** 
»flHHB^a4r-SftrBMfcA**«» A*£;h,fc.BB© 

#a, HB#-§-fc#a, bbeb^b, a««i«#a, 
BBEB«#BtffcBBB*#»tr*u BBteB^a 

5#jaw#*iiiH#»i. ii«iH»*a«:#La:ir«B 

[0019] rixlCiU. _kEBBfcJn*.-CW*BB*r 

#»a»e>A*u w*BBtfi»©***'£tf«9#B 

©-&j3t#B£ fcBfNi: i V MZIXZ 5. 

[0020] *»ijUfci3^-c, MlPftt«4?aii«i6 
B9fltf>B:R £ ffi«fcB8-*-5 *UUb^- * fcClg^a** t> 
A;0U B****afcllM&^-*SrB*1"a- 

otttBfc^WkJfc*- 3 "^**^ ^<d^-* <« 

£) $rA^LtA^B^^fi*aT^-t-5^£^J: , 9. 
BJ&fc ^cBBXaoBBfcfe^T-twBft^— * tcig 

[00 2 1 ] #BWfc*N % -C, fW««*»£#af±BB 
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*^A^3L, BBB^afcBft^-^SrB*-* - *- 1 

* sra^H««iS¥a«^as/6^A^i-f-5 r £ 

5. 

[0 0 2 2] #»Bfc«aWBBB»Btt:, *§B## 

wt-JH8£#a*r£trBBAA*»» BMft<aa#a, « 
B?*- ^y hBB#a«r*r?-5BBW#*fc#a. bb 

io 1E*#B. BBEBflWMfctffcBBB5*#»«:*rU ■ 

mm^Kc^w^om'Si.y *— w h^an eb# 

BSfcttBBEBBBfcB«$ftfcBB*Br£©7*- 
-eyhfcBBU BBW-JNfc^attEB^aSfcttBB 
EBBBfcEBSftfcBrJfcoBB'?*-*®:^-- ry h 

SrBBU BB*BB#aH:, A**HfcHBrt©»je* 

[0 0 2 3] ~*U£<fc?K lltJ6Lfe«ttrtt5*9# 
20 affii:HB'&J«tea«IB«rBjLfcBB«!!a¥afc*si^ 

<D^MS#aSrl*3j^LfcWC% Xfi&tlZm&'r — 9 

[0024] #^ejt^3H&*&ai£ef3\ *s»)t# 

^tffi^m#a, 8*»«**ya#a, Eti#as:^*J 
^ft-§-^^#asr^tf®^A^*a. s^a^a, ■ 
B»*(k*a, ®^E®#a, BBE«at#attrfcHB 
*^#a&^b, $ijffli«-i-i6^#aii«^^#tf®JffiiJ^ 

30 #f&£^U BBff^k^attBBf'-^SrW-^bl-. 
^tft^JifcBftf-;? 1 1>fc«B*fl=«rE*«H** 
fct±E*#afcBJeo7*— h-CEBU, Pi^a 
#a(±A^3 *H*:BBrt«>B3e«9f«ftliJ«iaS:tT'' \ 

EB$ttfc («*) m&t*. i^ft!;S<5^t^ 

[0 0 2 5] rWcit?. Bf^^^S-tJ^TPtiSgEB 

40 #bJX5>o 

[0 0 2 6] *BWk:*sv^-c, fcfgb^-^m, Bfi?B9 

ct^5 ^ro^|p^fcf±^ortge^SrA 

^(O^X»ig?fl84 ^SrB-cB«illWBrt»©B«S: 
ttfcUi-3 r £ ^ ± 9 ^^ttttlSr g WiWtctT 5 r. t * 5 "C 
#*. JEfc, BJftBBiKPWWHfcoiHIfc***!*— * 
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[00 2 7] *«WJC*5^T, m®^-?^ ffife&ft. 

J; 5 tc^Jt®&i1W*«&co?i : *i: &m*- : 8c1rZ>m 
[0028] #$gWc:fc^T, »#&#f*, 6g3fc»2fd 

[0 0 2 9] *^PJfC*J^T, ®&#L3l#i9:fi, A*$ 
*vfc®&cD»J£Nr ©«Je^# i *f *®«gi©«J£3:# £ © 

xwtfe<Dm&&&&'f7'?tcm, w&<D-&j8.t® ! m$:mft-$- 
<Dm&b&&Ltcm\z&f$tm&j!>mt>h : 5£oizirz> 

[0 0 3 0] #3§SJ3fw*j^-C, Syffl)«-i§-3g£¥i&fi> # 

mm*At) mm) vtc^comm^ mw&ft 

[oo3i] *%w\z&%m&® ! mjjmte. m%.e>w& 
(Dm^Att^^nm^tctt^^'r y?. ®&a^-£ 

fc^jj&m^^ ^Tttaj $ *itc®&w<Dm&. t ffifen 
mfa^mzu&zfotci$&m&*&ffct%m&&j&*7- 
v ?\ m&&i$.x7- y 7"? ft btitc&f&mi&coffi £i2t§ 

^Wl^(DJ%%.7 -y bfc£Z>nd,m$.tcliffife£:n*z£ 
S^cd Mfi SrtT 5 ®& Mfiftm^&x =r -y ~f k 1>*b 5 

[0 0 3 2] dtUrJ: 9 v W&A^&tt^ja^-^t&f- 
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[0 0 3 3] immvt. m&At>^WLXte*Ty?*k. 

¥®x&xTy7k. At)mm*t>mi&&ftz%i<^xm 

fe<Dtt&m®**#>Z>mi$tiltii^®XteX7-y7b. A 

iim&o o htt&mmxtett&mi&zfo^tciz&mmo) 
m^m^mmzm-r m&£&&®xiz*y L yfk * 

Mft*Wt&lkWj:k'fribfem\z!&fe-tZzb&X'Z. ffi 
mo>&$k*Mx.xWi®.-tZ> z.k<nx^ ZMi&mwxiim 

10 &At)mw*m?ix'Z z« 

[0034] m&Ajj^&k. m&$i^& 

t. nm^mm^mt, mmL&^-vwt&^wt.k. 

zmRmmm^& t , a^k&cd p tb^w$.x\tmk 
^tcm&m$.<»mmmfe<o&&* j ifo*mm.m 

20 - Ywcfe*?- y?t , At>mm*b^®mmm&*- k 

^Sl^^x-yT'i:, ^ffi«0«#«SS:A^®^^S^: 

rt^#mt-t-Sc &w-mzfcttc&mm 
30 5iir*>m*5®^A^^nm-r?)„ 

[00 3 5] Sfc^^fi, S^A^^XIi^x s/T" 

t, m^wmm^xn^'r-y^'k. m&&&*-h- 

Wt^WLX^T-y^k. %&mi&giWXte%WiW&$z 

Y\zm^\,^x^tsmm*bmi£<ott&ffi$.***> 
z>m®tem^&x\-ixT-y7k. Axm&vo-tbM&m 
®xtett&m®z^"tci$$;mi&<DmGL\zmfe<n$z&:* 

M-tmmz$k^WtXte*T'y7°k ZMrffi-TZ ~ k *%sWl 

\,^xmm*b&W)&)izmm-tz,- t^T?#. io, 

to ttm^(c^LT^TMO^SrJfeLfd±-C*liS^A^i-a 
[00 3 6] *^PJ^*J^T, ®^^©X»i^7"s/ 

^SrA^L. ttmmt$,ZMi2i&tirXtem&£&*- Ktc 

so [o 0 3 7] S^IS^SXfi^xs/^ti. 
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[0 0 3 8] ^UniCjSb^-C. BMMHM^Xtt^y 
?"tt^««fcBfr£©aMtf £ 

[0 0 3 9] *3SWfC*JV^, B&^ifc^&Xfi*^ s> 

[0 0 4 0] #38Wfc*N v t, g|i£ttttl#I§X»4:*7 i :y 
7te^£>At) £*Lfc.W*IBfc t A* W£ t ©g#f*— * 

[0041] *&wiz&\,^x. mmm&wttt, ^© 

fVv£A#W4ft£<0*©#l*ffi^*^ «©J*as0f£PI 
^Sl-SEtS^HSxV^^- h-tf'A'fcAAHffci:©* 

[0 0 4 2] *^K»-*s^T, Hte£gM£©Xf4*-r y 

^•(±, ^fswxriw***©-^^^***^ 

[0 0 4 3] #j8?l!fc:*sv*-c\ ««ata#«x»±^^y 
Xf4, ttttJ|MfiO^|f-iRSrA^H«i{-*at.TWfESi» 

— if I4tt£ti $*vfc««©*ffl«r*B Lfc 5 

[0 0 4 4] Jt^SW-fc^T, fil«tS:3£#Sa:Xtt^7-s' 
;/ , tt»W©'ttBXtt:lH' X^jE^tSrSrWi"?. r. t 

rHK4.9, »Jg*Hfc*»fiH*Offi«Xf±1»- 

[0 0 4 5] *%BJ{-*5V>T. •gg«ttffi#g;X(±^7 : -5' 



76 

:/(4»f&*W-S^T-r>'-7 , V- h^^SMfeODA^J 

\-^)vm^<omtm^wmmh v,xn&m$.<Dim 

tftSo 

[004 6] *^B^»C±JV^T, 
[0 0 4 7] 

[oo48] mat, *&w<ow. i mMm<Dm.mm^ 
n??a**t. JWftWB*Has6B i 014, «I£UVX 

/ -9 &&mRvmwir?>ftmmwmi& i 6 , 
mm&asi 8, ieis^«2o, »BSjfe<ofM*si>, 
«=©iwfiu wBteSRiraBtiiaoiwwt**:*^-* - * 

ftlJfflKg ^^tHjgg 2 2 , EVF (S^Ca--77'fV 
2 6, * h o #3g}tg!B 2 8 , |Efifei«flS3 0, ®{g[??-S§- 

fclalSg 3 2 v ®^i±l^ltal8S 3 4 , ft^t^amiHigs 3 6 , 
[0 0 4 9] «*/<9*-#ttWfM»iai6l 8rt. 

*r. 6IR*rXl^^ ho#3fcjSt2f) ftiTSr-^tJ'c VJt^rA 

[oo5o] mm^vmmk i 8 «, <f>"^» 

(af) bk, etbsmftijffl) (ae) ek. e«*j#fw 
w (ago siigftifSr^rfs. 

[0 0 5 1] Jgjj*3B#3SB2 6»4'<>'a= 3 r— SO J /X(4 
so +*d|f— 7fcifa»feft5 0 LR,*S7<f^K2 4 
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\z.9 yf'***'**— MtZiiXid'O * IkTfrf 4*-?\"< 

2 4 <DmmzWii¥m'**^ft&*£ftz>t •?:© 
[oo5 2] mm* a oa» w*.tfs txf-^, * 

[00 5 3] HM-^fbSM 3 2 »4. BHfcf*-* Sr, » 
[00 54] HI 2 &#HB LT. *H*«©«ft«J«:»f^ 

[0055] a— tttai-^ttrsflfSr^tfpfift* 

flHBl (SI) , M53HRifcft2 6fc£T4:ffl^-C«¥# 
ttffi[H]gg 3 6 Ic <fc 9 »¥fl£©#fti-5^HlfeSrttta-t- 
5 (S2, S3) „ MZ.t£* S*f^7K2 4l:« 

iA2 6 let ^jf^ut:, ^¥^«w©asi^§rS^ 
aaiaBi3 etKjei-a. *w#»iffiia*3 6ii, 

xj/i^-^li, A^iS^t-^LT, JUfcK^ftKJ; 
9 , «*tfS OB E LM77'7i'7y!iWSr»- 

(cLTWfetvSWSIftrt^©^©®^* 5 . l&^ttWfc 
£ LTttttiSH-S (S3) . «9fl:o|fcWlctta-t-*H 

[00 5 6] ttffl£;fcfc*»^«©Mfc^-*H:, 0f 
j£©JBK#5t mZ.fi. ^i-y^yh^WDCT 

ifclHX * h o i?) * if ©»»*# i t 

(S4) . 

[00 5 7] WftB^SrSi^XttATJi-S (S 

5) . «*!B*«r**L*!iSfcs fttctttibLfc&^fttli 
«SrlEltaSlt2 0XttlE»jBIE#:3 0i>feBE*ttJ-f (S 

6) . WftiS^t^^H^i:©^©*^^©^^^ 

Bfc©»W*lMyH*rflSEL (S7) , *9#©IMW* 
iE-C©«*W*i:©**&f J l E ?tfl2Sr1?v\ &.&#mHL 

2 4 ©Piffiif-^^t"^ (S8) „ StFtV 

v. 



(10) 

[0 0 5 8] 0 3»i, Sif-f^7"W2 4©S^ia 

**x-f 2 4±(cii x am&song 

&*^®&4 0a, 40b, 40c, £>j£Sf4fe&**fHtt 
4 2, ttXat^tr^-rSteX**^ 4, «/h***r 

»*t5l'h#^V4 6, ±Tfe&~©fMft«r»3W-5 
4 8 , ttoaa^OR 9 8:J§7F1"5K ?*-5 0 
a, &tflfc©&Ji^©«l$£m^1-5i£9*-5 0 btf 

io [0 0 5 9] 3-— !f ©Jfi*fcttV\ &¥#®&©{£«.K. 
tf-7MX£p&i-3 (S9). r©l**T?t±, *9fls© 

±©^¥fr®^Srffltf J: 5 K:**$*b5. »RS*ifeflk 
^#H# (0 3 -Ct±, tt9#H{fc$**ffi1*4 0 a (C*^ 

^$*v£o -©± 5fc*m*"ifcl±Jlfci-C*>3. 04 ti. 

[0 0 6 0] 3-— if»4, te7C^^V4 4, SI/hJK^V4 
6&UHfce^5E^©^Ui=¥-4 BWyf^ 
XttJfifcJ:!>*«sL-C, *£*Wfc©1f-fXXtmit«: 
^H-C^5 0 w©J;5^JH^.^Sr€6oyt^77-f */v- 
• a.— f ■ 4 ^9— 7i- ^iflr«J14a^fo5o 

BWMMfcKfcLTfc'J:^. M9^V5 o a IcJ: Qffr 

30 [oo6i] tta$Hfc**fris*©i>-'f xsime© 

-^■'fk$HTlE®$^5 (S10) „ r<D|E^©PI-, 

S^t 5 — 9 • Vr4A'<n^y9Wt}Z\z.W&\sX\> 
«tv\ f*fif1f«t Ltd, *«*#©«i»c % -g-figiE^ 
©*^<WB^©*W?l»Ji©#jft©flE«, *«tt?I5i»t-^ 
40 art- 5 Jg^# (fisj x v 0 3 5 2 ) wfi'CMia 

[0062] ZcDXoti:* «E^^©^, ■&eSt) ? lT--l' 
I»lilLT**7 f ^^7'W 2 4t-Mib^— 9t LXm 

mzmtxx$t*-tz>z t fc#5c ::©«): 5 (-1-5 r.£ 
so -t-?>#ra^< ct*5T-t 5, 
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[0063] m 5 ttm&^#m«©f&$Bi»s:5tefcir 

-f-^—Vk7^ir 0 sii~si5f±,"H2osi~s 

ma^u (s i 6) , &3f#m&<DtiLmRW'( 

(S l 7) *<D'ik. teffi&^#B&-r-*,S. 
^f&t*«^-*£A7jLT, S^B^^f^©* 

»cA5J:5tcu-c**iii^^b (s i s) , 

#l?»CJSCT&^f£B&£ttiEL (S 19), -&/&B& 
SrfS®^3 0lCfE®;i-5 (S2 0) „ 
[0 0 6 4] fc*S, *f*Btei:> ttm^SOff^tV^M 

£6fc^Tf4^*NM£^fSJ8£fcfefc^o ft^T, r© 
^#£A;£/W^«:f:£-£«>Ttt)ffl LTffl^T fc £ 

[oo6 5] tot, itKWictt^flEttaaaKij:*)^ 

6 ic^-T J: 5 IO**«KEjWC* Lfc®&&|g 1 ©®& t 

«Dpi^ffl«Sr«*i-^ J: 5 «w* l ©©&&-S-J& L"Ct> <fc 
V\ E6©#^#®&4 0 c f±, m^WB 4F*9©®&£r 
tttHL-C#S>*W!: *>©■?#> 3. r ©*-£■*>, 

[0 0 6 6] *!8W<DB2|llSflJSrUiWi-5 0 ft 

(JB2BMH : «)B-l>itlSt:Wfc*«' x . ) i*-J*U * 

©Hlffitaj©«SB&#f 4r*i" 0 El l t 
S^tcfil^CW^-^Wbtr^So l 4 OtiitflfceSE&fE 

i 4 2 nmmmmmK* 1 4 4 a. Wfcr-t 

• 7*— h^lelK-C-feSo Bf|fe7*-^7d— 
h^&laliSl 4 4»i, SfSfBWlElB&l 4 2^Sr^-UTA 
MSiAffl^d-^y hwB&x-^SrE'r^©^^ 
SCfcSHfcU Bf«f*-^*riSflrWJ»EIISl 4 2£tf-LT 

[0 0 6 7] #|EK«-c»i» fg 1 Btta*. $3 9 ffl L#tt 
{c^T£nfcfe^#B&-efc3*§^\ SlS^©A^3 

2B& (W*®^) i^J*i"<5. £2BlfeK:*tL 
T^i*:ttffl^SSr ; fT<3"C, W> 1 Bf£ir-§-J& t> ± 
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[0 0 6 8] ii(S*JW®K 1 4 2 Srrfr LTfl-fTC^ibATJ 
-t-5H«©»lB«SttJnaift©*«i: b-CJi, #J;itf, TV 

f> i£« £tvfc7 t /W^jS© :SC«B&Rt59 JIBflSt 
If, ft!l©B&A7J$l« 

— ^©«S"Jt>, •to?*- h&ffl%u<z>i>wbftt£ 

[0 0 6 9] ^MSWCtt, Kfi^Wi^-^^^ 

ft, xtiT'-*Bi£h vxn^tmfo7'-**m\ a 

S'J-TSo i Ltli^ DPCM^-g-^fcfiMR 

£*WiB&x-*, 77^^iUtMPEGMQ 
uickTime (*i7 y7*A-a V — #tfc©iS 
flD fr<!f©ftB*i-JS©t>©, JPEG, TIFF, BM 
P/DIB, GIF, P ICTMPCXfe^fj'h 

^©{dlP PT^ifWJS®^-^^. tWlXL STiif 
0^7uy K->— h-T^— ^^^BjfgX'fcSo 

30 [0070] A^$^fc®«7 f -^»4«-i-'fk$tu, WO 

5— 5£©ff£5S (TIFF, BMP/D I BXttJ PEG 

[0071] as 1 ®«a s *)H4fe-?;fco-c, -^©tp© 1 7 

1 — A*»e>«9#:SrttfflL,-CJB2pf«l («*®&) 

j^-rs^-tcn, if &m$L ufc 1 7 u— A*5^it® 

[0072] mi wmsmz&i*fti«iM£frtc%hni&-? 
40 $>!9, ^2®^tS)®ff^©^a-}-rt, ^rtse©®^ 

Ig^LT, «^{*®^ (W*®^) iKfftS&fcfbB© 
[00 7 3] H 8 £#J$ Lt, tH 7 {C^-flllS^J©^ 

©3a«©loSr^$lL (S2 1) , ^©B^ATj^e 
- KT-A*^^B^5:iaigSe2 Ot-t&^L (S 2 
so 2) , ^^T'W 2 4tcS*i"5 (S23) „ 
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■*M4fctt-je8c*AA u e«as« 2 0 ice**-* t 



[0 0 7 41 iflis r-f^/K2 4l:^Jiv5 

r7u-A<sr,i#>L (S24) , nMt irXftmrnm 

2 OtC*&Srt-f-S (S 2 5) o 

[00 75] a— !f tt, 9$ 1 Httfctt LT**a#3{M* 

<fc9$¥#Wit3r#ltti-r3 (S2 6) . 
5^^lS^(D{5j!:aS.U t -y-'f Xfcigg-rS (S2 7) „ 

s£VMi*7Kr-< ^T'W 2 4^©*^j£&5rT(f& 20 
[00 7 6] te^B^&tf/XttWJRH^f-^:©*^ 

t (S28) , <&&mfo&±i&i> (s 2 9) 

1 4 0lc:|E®-r5 (S 3 0) . 

[0077] tits, mmgzftt urfiSBj^trowa^t/s 30 

T^T'^SO f /Xf±feP5rPST'#5«t 5f--T5 (S 

3 1-3 3) „ rtiit *l&&##Wftx-*fc:ttJRb 

K5t U ( S 3 1 ) , 0 9 iC^J^-T 5 £ 5 \Z % 

\cwm£&m*y'( k/<— (xtt^^v) 150, 

S=A (v- f ) (1 + (v- f ) 

^2r-T5o ttoT, dpSrffSSU f Sri^XfMj^fc <° 
i£ (1) K£-3#> «Sjf-^Wt^XSr« 

[0 0 8 2] *fc, =>-— t-c»s%a«# 

* fc^tf>lM Xft £*£^IE LT () <fc lr\ 
[00 8 3] ±E»fi«-Cttffi Lfc&^#tttn8fl?£t& 
-jftttfctt, HMMMMft (*fctt*ifb«$l5*lrt 
gpro^T'— * t LTWv^^f- *) Sr#l>ffl$i3q5 (X 
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m&£mmx7-< K'<- (x«^^» 1 5 2Sr«* 

U f-&<P\frbW**7 ■< K'<— (Xte#*>") 1 5 
0.152 fciWrt-S t > *9i«MMB#©feflftt* = 

yh?^h (xUBJSSt/^S) aspg^axa (S3 
2) . gfl*. *9#©»Jg»»Sr}B3eu-C4»e>, ^©fe 

!E&*!^&A;*rt-5i: (S3 3) , £f&iIi&as|E 
SgjEfrl 3 0lCfE&£;h,5 (S 3 0) „ 
[0 0 7 8] ^C0J:5^LT, «JK©^.»T-fS5g^S^ 

[00 7 9] _biB#HJfc0iJT\ «^#ro«ia*&Jl*S*£ 

5««#fW*MSMMB*^-* t UTfiati^B2 0 
X»iiEfll:j&#3 0, 1 4 0 tcfE® LT&^T t <tV\ El 
1 0 Ic^-T J: 5 ^ 1 

5 4*fS»t, 1 5 4*Mf 

^0^2 2^5, -?:<Dtttb^$15i^7 ? -<5'SrlElS^B2 0 

K2 4 <D®ffi±frttft^fBi» 1 5 6 t LTA^ltC 

«1 5 8tt, fe^fr®^4 0 c t-ffcL^< Tt>AV\ 

[00 8 0] wtfeistitiM&&w m\m&mmRxm 
(•&««* if a^aurrs. ) ^i'cfMttiaox 

^^$TttlbteH5i^l 5 6*5*^^^^ 2 4K« 

[0081] ^.^ggptsr f , -sm^'owm* 

dp/f) /f (1) 

[0 0 8 4] JM£l$tcfi, ttWttlUSr^-^ti-S^ife 
Srttffl-t"-5 (M. Kass, A. Witkin, 
D. Terzopoulos, " Snakes :Act 

ive Contour Models", Inter 
national Journal of Compu 

ter Vision, pp. 321 — 331, 198 

9, «)»itell5a?r^±©^fP»-iRm$-lir5t«-Cfc 
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»©*W&±© £ rt I*] # * fc (4* ft * O^* fcflMB * * 
5#fe^»^tfCV5 (MtS, R. Ron f a r d, 
"Region — Based Strategies 
for Active Contour Model 
s", International Journalo 
f Computer Vision, pp. 229 — 

251, 1994, sfciHfc -7^^ y Viffrh 

aam^t&xsD- n, vol. j 7 5-d- i 

1 > pp. 1111-1119. 1992 

[0085] v m uo^ifettWcRRjesaxfc^ 

[0 0 8 6] ^•3tnLM*«tefii^:#^<-Bi"t" ; 5** 

13 9 fflL;xl4®*£-£-J$£fr5o ttHSiSSrtgBoa^ 
t> 4v\ 

[0 0 8 7] El 1 1 14. 3|fcJi«<D*l&*WJ 

a**-*". HMWBfcflyastB 21014, v 

12, CCD-C^-v 5 ir>'f-<Oj:5^*^T-2 1 4, 
6 , ^fg-i-^SlHlK 2 18, IBISiSe 2 2 0, WtM 
mm%-*&±1rZ>fflffl®&2 2 2. EVF (S^ta- 

^51*?SS2 2 6,* ho#*3tSS«2 2 8, fSftttflc 

2 3 0, ■IfcflMHIslglK 2 3 2, SHtttS^lelSg 2 34, 
^¥fftttiilsliS2 3 6, |0{fe&3UB]B2 3 8, MtfKlt 
f&*- 4 0 SrAflH"*. 

[008 8] HI 1 2 IC^-T i 5 if 210 £r## 2 
10a i: (S^iaSgB 210b L, HMt^SglS 2 1 

0 b £4ft9ti£tttillE]tt 2 3 6, tf ££&|hI& 23 8M 
^7^7"^ 2 2 4 b&HX^U 28 9 £##2 1 0 
a <t 5 K : UTt ±1 \, 

[008 9] $*f-( ^7*W 2 2 4 (C^ y^/^/W^ 
— ^t^tt"C*Jt) , 2 2 4C0Bffil-$! 

[0 0 9 0] KAA^HuaiaiK 2 l 8fi > jasete^Srg: 
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tmm®&* w&&*2 1 4©*ffi*«*MRtf/'x»± 

^3t^*2 1 2©R0©MaS«:M«f S*3fc**JW 

*£-r*«««*S5£0lS$:JMI|-t-5. w^b<D-gC 
14, h?:cTfcJ:oT2&3lSii5. * 
f4, -e-^&RU^ftiwJS^I;:, WM^ri^i, 

*T, SmttRV* ho#*ft« ftiftrfttf. «u***i 
io 14, tt£Bffcte8&B2 1 OUirtiKSixSffiiBMfcHJ^IB 

[009 1] Bftfeffi-g-giatgllg 2 1 8 {4, ^fV7, =- 

x (af> dubs, intimiHfP (ae) nigs, nwmn 

ffifp (AGO -El64ifSr*i-5. 
[00 9 2] IBttSEC 2 2 0 »4, 7 U-A/< y7r. t' 

HIMKfcte JB v > 5 *&J1X uifyM,t£E Sr*&*ft-t" 5RO 

20 [00 9 3] GMt# 2 3 0 14, ^^-7°, 

7yi/a^*!)WI C^ 

5o *H«i^J-e»4, iE^»£#2 3 0(4, ttaUOttttKIB 

«**w!tv\ mmm»2 3 014, ^sk^ssis 2 1 
o{r#j^,iffi-efc5o 

[00 9 4] ■lfc49-^k:lBlK 2 3 2 14, PHfe^— * 

[00 9 5] *3Hft«t»l4, «g£&# S»J#)l-«f£ilH£ 
»4, Kt«c g£&«f^-KK(4, *e 

XStme^if^ot^T, la^tU^-KtT-aT/v 

[0096] ^mmmx'H, T=tv\zm-t-z>* 

? t UT^felEtiiB 2 2 0 Xl4iS#sE®:^ 2 3 0 tC 
IE«L-CffljRl/T*S< t>©ti-?)o ^"X/^$Pi^ 

«5i^>o^^?>t><0, ^J^lJ4, #ffiffiilij)CmilIAl-.fc5 
^sp7 - 3 2 0 0 8 e-f-^lCfE^^ttfc^m^fl 

[0097]. SHj^ttl*- KT?f4, «»i-*;fr8sfc J: 
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[00 9 8] KOrt*Srffll|tKlftMi-5. « 

(MAP) i—HXtfS'S w-e 
14, A*H«l*»6»5fei" A*©ffi«X»4«ISr*til-*-5. 

[0 0 9 9] «^(*g©^ai*!iat LTI4, fl&t^*x 
^U-MSffe <*»HiftXtt#7-IS<lt) SrfflV\ » 

[0 1 00J T = »T>HRflr*— K-Ctt, *JfflJlHlSS2 2 
*hzme>tt&1fote¥) Stt^^t'W 2 2 4 01B1C 

[0101] gi&^tli^— Kfc*J^«#B*tJE-Ctt. A 

» T^S^— K"CI4, g W^x/Mt^ (j^lSXf4>i- 
11) £*ttMfc$P*il£ Lt^-f 2 2 4<E>iBffi-fcfc: 

[0 10 2] gBSi**- KT*(4, ffi$W£<Q*$m&, «(D 

5®#K:J3^T»feXrmefe^iSMftf&M&l-£& 
1"5. 

[0103] > $ -tw^M-i***- K-ei4, mmt$.<o& ™ 
tut, a©jm6j«^©f^*6j«^it«:f*ta u, ffiof© 

[0104] U±<0&*- K(4, «P?*©#««»Sr* 
t5iiMSt*5. Ell 3<Sr#fl8LT, 

1-5. * 
S=A (v- f ) { 1 + (v- f ) 

•CifcSirl-S. 

[0109HS-5T, dpfcff-ftU f&v>-Xtoef+ 
jBI#Mc4?)#tf>5r tfci ») , s£ (2) fc*<5l^-C*Mb 
CD-^ X£fg* S / A K*£o T^H-Tttf4 4 1 \ 

[01 10] &¥#ttttti£« 2 3 6 14, MJ£btt$Mft (X 
»4«ttH?Pi»rtSP«?«W«^— * t U©-7^^f-^) 
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* [0105] ^--f i f45fe-f, JBJBJ*- KK££eB 240 
K4 (9 £&*f^- KSr»jrt-5 (S 4 1 ) . ggtiltjg 
*-KK£«, 3H&<DM*tft5«^#£^t?iIi&S:li 

(S4 2) , aattta*- K*»T=»TA«je*- 

Ka»«rWJ-f3 (S4 3) . 

[0 10 6] -7 = 3.T/V-^3t^— K(0^g- (S4 3) , 
Jg^S^5l1B2 2 6&^£ffl^T&^#temi£{t2 3 6 
£J:0*S#©#ffi1-3<fc1IS:»J£"*-5 (S4 4) , 03 
;ll4, ^MSB2 2 6 9 b LXsOfJ^nhV* 
io ffl^54§-£-l-f4, &jtt ! 4*'f\s<< 2 2 4{d«^$Hfc 

[o i o 7] atMfcm^-K©^- (S4 3) , (mi 

4(^1-4 5 (-) , #J#PI3fc 2 2 2 14, *tlo*IW»^- 
*SriE«3£*2 2 0Xf4fE®gjc#2 3 0«»6B*UJt 
(S4 5) o i*f^^7'K2 2 4©Bi± 

5 0 (Ell 4) *r**L"Ct>J:v\ «gb^$|5**fflW# 
20 ^y248 (014) $:if-rri:lc4«?, 

*»iBtbSJh,5J:5KUTfcJ:v\ ©*f Sb*fc?B8H4, M 
»UfcJ:5fc. WftiSSlt?t?*$;h,5ffi©^itfcft2?-Cfc 

5c IP*>, *ic*J-*CD^«Sr^-rfclt<0-=!'-*i:f4m'i 
5» 

[0108] SHj»HJgg 2 2 2 14, £ 
(»fcfgF*Xtf»l*#|fii|fci?) ICJSDT, X(4^r©^ib 

attWWSJfcLSHE-t-S (S4 6) c ^ 

t>©i: b, $IJ^|E]^2 2 2(4, fg* < S.U ? «t»SOtS^iE 

(DMstoy-fv-r x=^m-^L, jg^^-^-rxtd^LT 

Htt$|5^t Lt*/Tf-f^7 , H' 2 2 4fca^$*5c 

,^tee*^«^*^2 1 4<DWL&ffi-£X'(DSg.M% v b-r 
5t, BiffiJiO®^-^-<XSt4, TsE^-e-^^?>tv 
5. BP*?, 
dp/f) /f (2) 

SfcHtrt-S (S4 7) 0 fiU -7 = ^.T/^^-K 

m&<Dffiw*&^i>mm<DfsiMbmwm<Di)-'< 
[oiiu *ni60tm4, ^mmbmcmmxicx^ 

8 5 7 1 9-g-^^IE«$H5Si)^$|5fe 



t# ffl 2000-209425 (P2000-209425 A) 



27 

m&iHk'bk ft -5 «t 5 fc, ttMt j e?'A'*i9B-i"S ~ 

10112] iwMfeffKafr^iiiftiwisiiKHi-**^ 

J: 

[01131 r©i 5i-btrg»«jf-#?>n5«$i5l6 

fcWWttWef*' l' , ZtiUftX-' 0' tft5J:5 
tf/^^^tf*' 1' ^JS-t-5®«^»LT, 

mm^m^U2 3 KtiS 

SSrHtf-r* (S 4 8) . 
[0 114] f^-KtLT#glijE*-K 

#<-g-tfS*Sr8i^L. (S6 1) » -?r<D»*§t«g6£ttm 

•T5 (S6 2) . *bx, *<Dm&m®\m&-tzmm 

-CfcoT. JRXtt*fti?T3tSiXfcfe«^©«fflrtJw*) 
5H*©«-fr*>fe«;*fej«»Srttmb (S6 3) , 

(S6 4) . ft*fe£ LTtt!T*-rSfejfc5Nt*rT«>)£ 
[0 115] #B*jE*-K, >>5-ttf*»i-»**-K 

fH#©#5&asprfBftgi&*!y8 (01 3©s4 7-c#t$ 
*ta^*««©tttti*yafc»3i~5. ) ©-#J£* eh 

6 Sr#fig LXSiW-f*. rr-eii, ttgb$t$|5*!Ui, 

[0 116] 3tei\ tmW& : *7 ! >W&&&k L "C -?:©!£ 
a — Xtf ##M£*£ft if©«S'J© 5 *>©— ■ o 
fc&y$i-5j££rflbHiL (S7 1) , ZtiZ'tKOnWlktiL 

[0117] A^Bi^©^ y S?5ftflKMfeSr Sobel, 
P r e w i t t XI±C a n n y fc£©S»M1Jfc$H*JiESrflS 
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oyj/l-f ])^jnz£VX.tbZ (S7 2).flbJlti 
y 5?3ft*^**3f 3£©Wttt <£ 9 2 {»t; U ££ KJS £ 

frjp^-cusiJisi^-^srttm-ra 073) . 

[0 118] ttffl£;h/fc*l^«W»b*^v^-*i:l3« 

(»#*©**]) &&mL (S7 4) , rnrnn 

*^-*M©»«iftn**tt£W:r L (S7 5) , 

m©ffi*-r*v<* h/i-sram-r* (S7 6) . 

jo -e, M^ifDi:45J:5tc-rsftirL 
t v jE£M;£Ji& (S 7 6) o 
[0 119] ttfii*^^ h/Hk:mt5^ttS:#« 
(S7 7) , |»tt«©n«i-S«Mtt^n«:^ 
iSa*&;*^5W:'MMft£K:J:t>±J*U-c, (MM** 
fvwfcW-r?- (S 7 8) . 
[0 12 0] ft*M©«JSf'ttttt, ±5ELfc*feiwPS^ 
£ix£>©-efift< > fti2,©#5*;£ffl^Tt>J:^;: ti±m 
5*t?t>ftv\ 

[0121] rro«t *»$ixyt*l» 
20 i^f/KOi^ (ma*) rtgB©®*^ H^^m© 
«*4:ftS<»3t**i/fc«*-e*)5. Km, &gtOSC 
T, ttW«WUjfeftirtt©#ife«:fflV''-C*|jEU-CtJtV\ 

i&5ft«^©J|jMfe©**$fti?KJ:e>i"K, jtMfc 

1 4©utf>BM0 tsaoMft^ifi 

[0122] £iJi© i 5 fttt9fWttiAUAtnilKK]A 
mm<Dm. W*fl:BK 2 3 2 K&ft©BifeS:J£ffi& 
(S5 0) . |2gkj«ft:2 3 0lCfS®-t-5 (S5 

30 l) 0 itvtPWfc> H^au^m-§-^^iH]^2 3 
4*s, jtlfta©iiilli*»fe*Mft«* (NTSCMXliP 
AL^fJ?) Sr^U fflA-T* (S5 2) . 
[0 12 3] ft&itlB\&2 3 2^bffi^$tu*iii^7* 

If St*— *7 7></W£S&£&©S!??©Was, ^^ft^ 

«Ct > ift*BB^ IEJBM8Rt5JE***ft^ 

©Mflffflf«^|B®$HS. ^^f>©JfiP©IE&7d— v 
y h»cHi-.5*5.*&©-0iJSrlII 1 7(^i" 0 
40 [0 12 4] Wmf#fi. Sf«±Jw»Jtttttt»Jt'C# 
!tV^5lcS^W^Lf-^ (Proc of th 
e IEEE, vol. 83, pp. 944-957. 
1 9 9 5) t LTfE®L-Cfc&V\, «?tfi, 

Ltnoats ®^tp©^y ^^•J-a^^tpfti'©* 

[0125] *lllS0iJT*tt, 314 ©&^# 2 5 2ii 

mffl^e^i/.f 5S^<*Pi«2 4 2 c tfi^i* Lt>-g: 
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[0126] #3»swrr±, mmzHtc*t&mmm& 

Mostly l*MH"e£>3o 
[0127] HI 1 2 fc*"*1*J«-Ctt, $J^f£, 

##2 1 0 a J&»&$MiLfc»iM&«<&2 lOblt {*J;l w 
3 6 .ft tfilHfe£&lE]& 2 3 8 ©8S#Btt, 013 fttf 0 1 
[0128] JcC, A*H«fc» L±»OSIlS«-C* L 

HI1 3lC7jW-*Q ! Jl7n — irlRlC-efcS, 
10 12 9] (H18©S89) 20 

tt, mmn^m, mm&»* umm 

[0 13 0] i©H«6F!lT-(±, K*KJ£L 
(S8 1) , *r©gL ±»Lfc J: 5 **«©«*]**<> 

ta7>ftUc^^7°fSrI«t5 (S8 2) „ 30 
[0131] X«^£ftS*?ttflUft«:ttltttL, (S 8 
8) . *<D'&, ^fcttXttttfflSItt©^***:*!^ 

n-rz> (S89). 

[0132] mttm%m*- -m, ^«>a«**T,fc«© 

Si&T*— * ^Mfc*©®©^^!!^^^*^:? 
tTj/fy^ (frttft-^ hu-'/^j a 
ttf«£r#fiB) -t-5&3T-#>5 0 Ell 9 Id, mwia<D£$i 

ti. -tof ©— oSrffi*S^e2 4 0Srfflv^TS*i-f 

^^K^KATW^S^ftTV^o K©*-^* 
S&Lfc/gL iBEic*^:$H-5 ©**>-&i¥l- 
El 2 0»c*i-J: 5t-, ^7°U"Y izm 

if) *Sftij*»t-^T"t-5o m^^^f-^^yiL'^^ so 
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tt, tMMfcoy**?-*-?*-*** (2) fttftettiiffl 

[0133] mm&&*- kt-14, At>m&*<nm.ffi& 

UMSAfcJ:*1«B¥7-3 2 0 0 8 6*^*fcCtt*^ 
-yy MH4fc©*©#«fl (@ s Afttfnfeif) IB©** 
C©#£\ ±56©IH60!ITIJlWL*:Oiiai*fc, 9-f 

[0134] ummt*- K-er±» *«*sr«mLfc. 

^^fflicLXfeSMO^^-y^^/^-^ (v^ 
AIRE* (#fltf?(M4i?) o^/i^-* 

[0 13 5] £t±©*|ft«!aK:j3V^-C» 

figU-CtftWLfc©i:lRl^, 3E&*ttSi («#£*) ©^e-r 
/H»*MSl9 f -^*rlE1taSfll!o»6>AAL, mSrSC (2) 

©SrSMfef-Cjfe^EUx A^JiSlfeW^y^Sfift^d^* 
*fc^H5i»i:©«H{i^ft^ (xtt^A) t*Stt«Sr 

[0136] rttfewacuiftiaonrtea*:— jttftufctt 

X^tWftf-'f xtcKAdix (s 1 0 1) , fvT 1 !/ 
- H^e^/w©#«^i: UT^©HI|5^x-^±©^* 
3— 7-— Xtfft^B^ftif^ttm*^ Xtt. 1* 

f+«rtff«t fC**a**l5 (S 1 0 2) . A73W£© 
xy^Mft^trlfaUb (Si 0 3) , 2ttfc&tttltt 
i^ttm^SrtT^ (s 1 04) , fy/i'-F^-ea 
Ui$ixfc<»«*flR]«©'l*«**ri9i*XU«tttbi-S (S 
1 0 5) „ 

[0 13 7] Wft^MSr^ftlt-*-* (S 1 0 6) . £ 
#Xt5P*if©|BSr«*i-*«fi|ll]Sr«- 
fctttfZZ t*s-e#5 0 fiP*>x 7>'7*i'- h-=e^v©H 

46ig^]t-ls:^$HTv^©-e, fyyi'- h^r/i't*© 
(I. #Xt5a*if) loWWriKAAift 
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[0 13 8] MJS&WOtiL&-i'*l' < * h^SrttttlU fi 
•L-itiWZ&Vb UTIE^ki-^ (S 1 0 7) o roM* 
^aS^^^Hfl-t-S (SI 0 8) o 

[0139] rnm^'mh-^ (*?>•#) *assr^j^, ^ 
(««&$»£& if) (D^tetemzmjii-Ze 

l Ktturmfg^&a (r^lc, 0<a<l) i-rsgf 

1 tftSo 

[0 14 0] K^S^cDffie (S-L^iifoSii^'fi:*) # 
*r<Oi&lf|5i&£0 1 6 (c^-T^T** 

P^-rsas^wfe^MSr-^^-Sds X»4P^fflJ^07 L 
[0141] %h^&MX\±mz.7t<OW&7 : -*<»1g%. 

[0142] *(Dm<D£&&m.k \sXfa<Dmw&izw.Wi: 
$L?zr$ffin$- (0 2 2 (2) #ss) tewmm^. & 

[0 14 3] i%mifeik*ft?&&^^ ttW$tufc#gE 

jtT9T^***Hi"*-i©"C?*S , ^«9 (in-bet 
ween) if i •? . tcCtVT'I'- 

|BltlllBAfcJ:S«fM¥7-3 2 0 0 8 6*4**fclE* 

[oi44] &mk<on&<nm^\wkxi&m\z%k\,x 

WMIt*- * <t t h Lt*s<rt^ 
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<D^y?&Mz%tmi.Xb J:v\ ^SlBtro^li^x- 
^7r-r/vSr^i-^^-l-t4. t©^y^ttHUC»« 

[0 14 5] ffH^lrfftSittt;^, -?:CD*SPi 
-t-«fc5teLTt>«tV\ r^-C»4, aMtfi«tt=lW4i?fc 

[0146] «&f&fmtWc#*«#wf*ttJ,Rtf£»8! ! 
HS©7P-ft - h£HI2 3 (c^-r o 

[0 14 7] IMtPHfc&aHgL (Sill) , 
©«tfl'*#*:ttlilU (S 1 2 5) » !E«i£fi2 2 0*i:* 
(i|EtSLT*3<c KSrKJfeU (S 1 1 

2) . ^KicisfcKft^-yy h <*su featRt^a 

SI* if) »tf«*©e«*r»iM-« (S113). w 

#mr {ft<7>mnmx-(DA*)M&.) 1 (sn 

4) , r ©i: tttfflb (S126),Gi 

^12 2 0tC|2ti-f-5o 

[0 14 8] ft%:m&bAt>m&m<Dttfo£.* 
ttWL (S 1 1 5) . #»t>**t$>*.lc£C5IIIlE» ¥ 

?t&®x.vmm&®t£b'<D&wztei;-rz,tcib\z^ Mm 

*Hlfc©SMff^ttaf*/<9 ^ — ^ (77-f >-^ifeX(4S 
Sr*5^bx (S 1 1 6) 0 

?Ttttci-« (S 1 1 7) o 

[0 14 9] »j6jSMoffl*4ltRlrti3t*#-*if©iWk 
«®^©^5r^i-'5 (S 1 1 8) c A#tf)tci4, M 
0d>ib 2 5 5 U^/U-ecD^&P^^JcM-^S^flrH^^bA 
OKI, if) Sr%JtbT, BJbd-ic 

?&w®i-rz>z.b\z£.r), -m<Dmnm£&m&.x*% 

[0 15 0] r©J:5teLT*»4JxfcWftiff4fci:A;*j 
®^ t ott^tr i: 9 , M^wBlffiT- 2 fflMfrf * if ote 
SJdit), *^flcfll*^affl**t5 (S 1 1 9) . W# 
co*n.SJ4, 018©il^i^fefc5©t, »iW*IftW 

[0151] 
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Klftt U * ^ A^X Atufc g £ , 

[0 15 2] ^*B»*nfc*W«M!)»RJlV1»--fXi5t 
jbti ti MiblfeSPi^rt ©Ht Srffl ^ 5 fc* It t? i ttMictt? 
[0 15 3] JfSftAWSfcli**©!***). *©JfMK 

[0 15 4] *^PJ(c«t^«v fMMfefftrffiv^ 
[0 15 5] «U*#£#fiaLT, 

[mu *»w©ffimfc«o«ws«irii^'ny^Bisr 
[02] *2£(*©MiiHAtra*wfci: ©-6-j*iaeo7 

D— ht?fe5o 

[1213] S^x-i'^T 0 ^^ 2 4©*^iiliD^JSr*-t"o 30 

lias] Ttcujfi^ro-a-^arosijw^D— st* 
[121 6 ] *3Ui[ffi[©»j©aan0ii-e*)<5. 

[1217] *^PJ^2Hffitiaj©SEBS«^n j/^El-C 
[1218] |2|7fc:^-MIJ60y©Ibf^7a— ^•-v— ht?*) 
[1219] ■^=aT/i'-ePtmatf/X»4feIIS:«S-C# « 
[12110] ffigj^lPS^^^Vl 5 4SrA«-t-5tSffi 
[El 1 1 ] *«W©JS3^tt©*W&*j5K7*n ;/^|2l 
[12112] JM**W©£MM©*8**J«7*ny*BI 

1® 1 3 ] *3iEHi«»i*5it5aejw»f5tea©#«sr 

[12114] ^3HJSWc*5»t5^Wffi0in?*>5. so 
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[015] *3Xttflfc*l*SffftiEate8«>7n-- 
[12116] m3^«Efl»J^*5lt5ft^ll«Sibttlilfti 
[1211 7] «3**«kl*Jrt5SilMa»7*— h 
[1211 8] BI^^SWSiJcD^D-^^- h-Cfc 

So 

[121 1 9 ] 8£ttin£&«&Bf wiiiR.* -^-*^®ffi 

[12120] &tttia&m&<Dmi&MX'ibZ>o 

[12 1] 1211 8\Z7jk~pm&$E&<Oift®!l£<D7a— 

lei 2 2 1 in ttmm&<owm&<r>%&iimi&<o 

[02 3] m^.^Wk^M<r>^.\z%\\(Dya-f-^— vx 

1 0 : «&iitfg!*a3S£EB 

1 2 : fftfcX4*X 
1 4 : 

1 6 : ttiHIMttHellg 

1 8 : MffcffiT -^sasiejK 

2 0 : EttSfll 

2 2 : ftJ$l{g^-3S£lH]8g 

2 4 : ^^X-^ 7*~7\>"< 

2 6 : ft^sft&v 

2 8 :^hP 

3 0 : |B^&# 
3 2 : 

3 4 : iS^m^EK 
3 6 : ft^tttiJBK 

3 8 : Bf^-^^lHlK 
40a, 40b, 40c 

4 2 : 
4 4 : 

4 6 : «g/hJK^>' 

4 8 : ^tb^r- 

5 0a: M^- 
5 0b : 
5 2 : *§S*J# 
5 4 : 
14 0 
14 2 



14 4 

15 0 
15 2 
15 4 
15 6 
15 8 
2 10 
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2 12 
2 14 
2 16 
2 18 
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2 2 4, 
2 2 6 
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2 3 0 
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2 3 8 

2 4 0 

2 4 2 a 
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(54) DEVICE AND METHOD FOR PROCESSING IMAGE AND STORAGE M EDIUM 

(57)Abstract: 

PROBLEM TO BE SOLVED: To synthesize an extracted 
object with a background image. 

SOLUTION: A user photographs images including the 
object to be extracted (S1), specifies an extraction 
range by using an instruction selection device or the like 
(S2) and performs extraction by an object extraction 
circuit (S3). The image data of an extracted object area 
are compression-encoded and stored in a storage device 
together with a photographing condition (S4). Then, the 
background image is photographed or inputted (S5). 
While displaying the background image, the previously 
extracted object image is read from the storage device 
(S6). The gradation and color tone of the object image 
are adjusted so as to suppress the difference of the 
gradation and the color tone, etc., between the 
background image and the object image (S7), the object 
is mixed and smoothed with the background image near 
a contour and the object image is subscribed on the 
background image, synthesized and displayed (S8). The 
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position and size of the object image are adjusted corresponding to the instruction of the user 
(S9). Synthetic image data are recorded in a recording medium (S10). 
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CLAIMS 
[Claim(s)] 

[Claim 1] An image processing system characterized by providing the following. An image input means 
including image formation optical system, a photo-electric-conversion means, a video signal processing 
means, a storage means, and a control signal generating means A directions selection means for making 
directions selection of the particular part of an inputted image An image-processing means It is a 
synthetic image generation means has an image coding means, an image-recording means, 
image-recording data medium, and an image-display means, and compound the background image 
memorized by either a specific photographic subject extract means extract the specific photographic 
subject in said image using the image information of the portion by which directions selection was made 
with said directions selection means in an image into which said image-processing means was inputted, 
said storage means and said image-recording data medium, and said specific photographic subject which 
were extracted. 

[Claim 2] An image processing system characterized by providing the following. An image input means 
including image formation optical system, a photo-electric-conversion means, a video signal processing 
means, a storage means, and a control signal generating means A directions selection means for making 
directions selection of the particular part of an inputted image An image -processing means It has an 
image coding means, an image recording means, a communications control means, image recording data 
medium, and an image display means. Said image -processing means A specific photographic subject 
extract means to extract a specific photographic subject in said image using image information of a 
portion by which directions selection was made with said directions selection means in an inputted image, 
A synthetic image generation means to compound an input means of a background image through said 
communications control means, and said background image and said extracted specific photographic 
subject 

[Claim 3] Said control signal generating means is an image processing system according to claim 1 which 
inputs an auxiliary data about a configuration and a location of said specific photographic subject from 
said storage means, and displays said auxiliary data on said image display means. 

[Claim 4] Said control signal generating means is an image processing system according to claim 2 which 
inputs an auxiliary data about a configuration and a location of said specific photographic subject from 
said communications control means, and displays said auxiliary data on said image display means. 
[Claim 5] It is the image processing system which it has the following, and said image format-conversion 



means changes into a predetermined format an image memorized by either said storage means and said 
image-recording data medium, and is characterized by for said image-processing means to perform 
specific photographic subject extract processing in an inputted image, and to compound an extracted 
specific photographic subject image and an image by which format conversion was carried out with said 
image format conversion means. An image input means including image formation optical system, a 
photo electric-conversion means, a video signal processing means, a storage means, and a control signal 
generating means An image-processing means An image format conversion means An image coding 
means, an image recording means, image recording data medium, and an image display means 
[Claim 6] Have the following and said control signal generating means has a photography condition 
measurement control means. Said image coding means encodes image data, and records photography 
conditions by said photography condition measurement control means in a predetermined format with 
encoded image data on either [ at least ] said record medium or said storage means. Said 
image-processing means is an image processing system characterized by compounding an image which 
performed specific photographic subject extract processing in an inputted image, and was recorded on 
either [ at least ] an extracted specific photographic subject image, said storage means or said image 
recording data medium based on said photography conditions. An image input means including image 
formation optical system, a photo electric-conversion means, a video signal processing means, a storage 
means, and a control signal generating means An image -processing means An image coding means An 
image recording means, image recording data medium, and an image display means 

[Claim 7] Said auxiliary data is an image processing system according to claim 3 or 4 which it is in a 
border line of predetermined size about said specific photographic subject, and any of mask data. 
[Claim 8] Said auxiliary data is an image processing system according to claim 3 or 4 which is the border 
line of a predetermined configuration. 

[Claim 9] On the other hand, said photography conditions are an image processing system of light 
exposure and shutter speed according to claim 6 which includes the direction of a look in the amount of 
focuses, a photography scale factor, and a class list of illumination light at least. 

[Claim 10] Said image-processing means is an image processing system according to claim 1, 2, 5, or 6 
which performs synthetic processing of an image after performing predetermined transform processing to 
some [ at least ] fields of one image based on a difference between photography conditions at the time of 
photography of an inputted image, and photography conditions of said background image so that one 
image may carry out abbreviation coincidence with photography conditions of an image of another side. 
[Claim 11] Said control signal generating means is an image processing system according to claim 6 to 
which an auxiliary data about a configuration and a location of said specific photographic subject is 
inputted into from said storage means, and a configuration and a location of this auxiliary data are 
changed based on said photography conditions. 

[Claim 12] An image-processing method characterized by providing the following A step which inputs an 
image from a predetermined image input means Inputted measurement or a setting step of an image 
input condition of an image A step which records said image input condition on a predetermined storage 
means The image composition step which performs generation processing of the synthetic image of an 
image of a photographic subject this extracted based on a photographic subject extract step which 
extracts a specific photographic subject from an inputted image, and said image input condition, and the 
**** image recorded on a predetermined storage means, and the image output-control means step which 



perform the output to record or the predetermined display means by predetermined format to the 
predetermined storage means of said synthetic image 

[Claim 13] A record medium characterized by memorizing program software of procedure characterized 
by providing the following A step which inputs an image from a predetermined image input means 
Inputted measurement or a setting step of an image input condition of an image A step which records said 
image input condition on a predetermined storage means The predetermined storage means of the 
synthetic image obtained by the image composition step which compounds the image of the photographic 
subject extracted based on a photographic subject extract step which extracts a specific photographic 
subject from an inputted image, and said image input condition, and the background image recorded on a 
predetermined storage means, and said image composition step and the record by the predetermined 
format at least to one side of a record medium, or the image output-control means step that performs the 
output to a predetermined display means 

[Claim 14] Have the following and said image processing means the 2nd image inputted by the 1st image 
data recorded on either said record medium or said storage means, and said image input means It is the 
image processing system characterized by said control signal generating means generating a control 
signal which displays a synthetic image obtained by said image-processing means on said image display 
means by compounding using either [ at least ] an image input condition of said 2nd image, or an image 
input condition of said 1st image. An image input means including image formation optical system, a 
photo electric-conversion means, a video signal processing means, a storage means, and a control signal 
generating means An image-processing means An image coding means An image recording means, image 
recording data medium, and an image display means 

[Claim 15] An image -processing method characterized by providing the following A step which inputs an 
image from a predetermined image input means A display for a predetermined display means and a 
selection step of the 1st image recorded on either a predetermined storage means or image recording data 
medium An image composition step which compounds the 1st selected image and an input image Record 
by predetermined format for a predetermined storage means of a synthetic image obtained at said image 
composition step, or an image output-control means step which performs an output to a predetermined 
display means 

[Claim 16] A record medium which memorizes program software of procedure characterized by providing 
the following A step which inputs an image from a predetermined image input means A display for a 
predetermined display means and a selection step of the 1st image recorded on either a predetermined 
storage means or image recording data medium An image composition step which compounds the 1st 
selected image and an input image Record by predetermined format for a predetermined storage means of 
a synthetic image obtained at said image composition step, or an image output-control means step which 
performs an output to a predetermined display means 

[Claim 17] An image processing system characterized by providing the following. An image input means 
An image display means to display the 1st image inputted by said image input means A specific region 
extract means to extract a specific region in said input image using image information of a portion by 
which directions selection was made with said directions selection means within a directions selection 
means which makes directions selection of the portion of a request of said 1st image, and said 1st image 
An image composition means to be extracted by said specific region extract means and to compound an 
image of said specific region with the 2nd image 



[Claim 18] An image processing system according to claim 17 with which said image input means 
includes image formation optical system, a photo electric-conversion means, a video signal processing 
means, a storage means, and a control signal generating means. 

[Claim 19] An image processing system according to claim 17 with which said image input means 

possesses means of communications which captures an image through communication media. 

[Claim 20] An image processing system possessing a format conversion means to change a format of 

image data from said communication media into a predetermined format according to claim 19. 

[Claim 21] Furthermore, an image processing system possessing an auxiliary display means to display 

auxiliary line drawing with which assignment of said specific region to extract is assisted on the 1st 

[ said ] image displayed by said image display means according to claim 17. 

[Claim 22] Said auxiliary line drawing is an image processing system according to claim 21 which is the 
border line of predetermined size which shows said specific region to extract. 

[Claim 23] Said auxiliary line drawing is an image processing system according to claim 21 drawn 
according to mask data in which said specific region to extract is shown. 

[Claim 24] An image processing system according to claim 17 which said image input means inputs the 
photography condition with said 1st image, said image composition means is extracted by said specific 
region extract means, adjusts an image of said specific region according to said photography conditions, 
and is compounded with the 2nd image. 

[Claim 25] Said photography conditions are an image processing system containing any one of a class of 
light exposure, the amount of focuses, a photography scale factor, and illumination light, and the 
directions of a look according to claim 24. 

[Claim 26] Said image composition means is an image processing system according to claim 17 or 24 
which performs synthetic processing of an image after one image performs predetermined transform 
processing to some [ at least ] fields of an image based on a difference between photography conditions of 
said 1st image, and photography conditions of said 2nd image so that while may carry out abbreviation 
coincidence with photography conditions of an image of another side. 

[Claim 27] An image processing system according to claim 17 characterized by providing the following 
Furthermore, an auxiliary-data storage means to memorize an auxiliary data about a configuration and a 
location of a specific photographic subject which were extracted from said 1st image An auxiliary -data 
amendment means to change a location and size of an auxiliary data memorized by said auxiliary-data 
storage means according to photography conditions of said 1st image An auxiliary display means to 
display auxiliary line drawing based on an auxiliary data amended by said auxiliary-data amendment 
means on the 1st [ said ] image displayed by said image display means 

[Claim 28] An image-processing method characterized by providing the following An image input step 
which inputs an image from a predetermined image input means A measurement setting step which 
measures or sets up an image input condition of an inputted image An input condition storage step which 
memorizes said image input condition for a predetermined storage means An image composition step 
which compounds an image of a photographic subject extracted at said photographic subject extract step 
based on a photographic subject extract step which extracts a specific photographic subject from an 
inputted image, and said image input condition, and a **** image recorded on a predetermined storage 
means, and a synthetic image output step which outputs a synthetic image obtained at said image 
composition step 



[Claim 29] An image-processing method according to claim 28 that said synthetic image output step is a 
step which records said synthetic image on a record medium. 

[Claim 30] A storage characterized by memorizing program software which performs an image-processing 
method according to claim 28, enabling free external read-out. 

[Claim 31] An image input means including image formation optical system, a photoelectric-con version 
means, a video signal processing means, a storage means, and a control signal generating means, It has 
an image display means in an image-processing means, an image coding means, an image recording 
means, and an image recording data-medium list. Said image-processing means the 2nd image inputted 
by the 1st image data recorded on either said record medium and said storage means, and said image 
input means It is the image processing system which compounds using at least one of an image input 
condition of said 2nd image, and the image input conditions of said 1st image, and is characterized by said 
control signal generating means generating a control signal which displays a synthetic image obtained by 
said image display means with said image-processing means. 

[Claim 32] A display for a predetermined display means and a selection step of the 1st image recorded on 
a step which inputs an image from a predetermined image input means, a predetermined storage means, 
and either of image recording data medium, An image -processing method characterized by consisting of 
an image output step which performs an output to record or a predetermined display means by 
predetermined format in an image composition step and a list which compound said 1st selected image 
and input image to a predetermined storage means of a synthetic image by said image composition step. 
[Claim 33] A storage characterized by memorizing program software which performs an image-processing 
method according to claim 32, enabling free external read out. 

[Claim 34] An image processing system characterized by providing an image transformation means to 
perform predetermined conversion to an image of the object domain concerned an image input means, an 
image pick up condition extract means, an image transformation mode setting means, a field extract 
means to ask for a predetermined object domain using the image pick up conditions concerned from an 
input image, and among the input images concerned. 

[Claim 35] An image processing system characterized by providing the following. An image input means 
An image display means An image pick-up condition extract means An image transformation mode 
setting means, a field setting means to set up a predetermined object domain based on the image 
transformation mode concerned or the image pick-up conditions concerned from an input image, a 
boundary layer display means to superimpose a boundary line of a setting field on an input image, and to 
display on the image display means concerned, and an image transformation means to perform 
predetermined conversion to an image of a background region except an object domain or the object 
domain concerned concerned among the input images concerned 

[Claim 36] An image processing system characterized by providing an image input means, an image 
pick-up condition extract means, an image transformation mode setting means, a field extract means to 
ask for a predetermined object domain from an input image based on the image pick up conditions 
concerned or the image transformation mode concerned, and an image transformation means to perform 
predetermined conversion to an image of a background region excluding an object domain or the object 
domain concerned concerned among the input images concerned. 

[Claim 37] Said image transformation means is an image processing system according to claim 34, 35, or 
36 characterized by performing predetermined texture-mapping processing to said object domain based 



on said image pick up conditions or said image transformation mode. 

[Claim 38] an image of others [ means / predetermined in said image transformation means / storage ] - 
inputting said object domain said image pick-up conditions or said image transformation mode 
being based - being concerned - others - an image processing system according to claim 34, 35, or 36 
characterized by replacing by image. 

[Claim 39] Said image transformation means is an image processing system according to claim 34, 35, or 
36 characterized by changing a specific color component of said object domain into other color components. 
[Claim 40] Said image transformation means is an image processing system according to claim 34, 35, or 
36 characterized by performing predetermined geometric deformation to said object domain. 
[Claim 41] Said image transformation means is an image processing system according to claim 34, 35, or 
36 characterized by adding predetermined watermark information to image data after conversion. 
[Claim 42] difference of a background image into which said field extract means was inputted beforehand, 
and said input image - an image processing system according to claim 34 or 36 characterized by asking 
for said object domain based on data. 

[Claim 43] Said field extract means is an image processing system according to claim 34 or 36 
characterized by providing a storage means of a predetermined template model image, a similarity 
detection means of a template model and said input image concerned, and a field extract means to extract 
a field where the similarity concerned serves as beyond a predetermined threshold or the maximum. 
[Claim 44] Said image transformation means is an image processing system according to claim 34, 35, or 
36 characterized by changing an intensity level or a color component value based on image pick up 
conditions about a part of said object domain or said background region. 

[Claim 45] Said field extract means is an image processing system according to claim 34 or 36 
characterized by what a boundary line of an extract field is superimposed on an input image, and is 
displayed on said image display means. 

[Claim 46] Said field setting means is an image processing system according to claim 35 characterized by 
having a location or a size-change means of the field concerned. 

[Claim 47] Said field extract means is an image processing system according to claim 43 characterized by 
setting up a location and size in said input image of said template model image based on said image 
pick-up conditions, and asking for a border fine of said object domain by making a border line of the set-up 
template model image concerned into an initial outline. 

[Claim 48] Said border line display means is an image processing system according to claim 35 
characterized by displaying said boundary line when a display action of a border line is chosen by 
predetermined display selection means. 

[Claim 49] An image-processing method characterized by providing an image transformation step which 
performs predetermined conversion to an image of the object domain concerned an image input step, an 
image pick up condition extract step, an image transformation mode setting step, a field extract step that 
asks for a predetermined object domain using the image pick-up conditions concerned from an input 
image, and among the input images concerned. 

[Claim 50] An image -processing method characterized by providing the following. An image input step An 
image pick-up condition extract step An image transformation mode setting step A field setting step 
which sets up a predetermined object domain based on the image transformation mode concerned or the 
image pick-up conditions concerned from an input image, a boundary layer display step which 



superimposes a boundary line of a setting field on an input image, and is displayed on a screen of an 
image display means, and an image transformation step which performs predetermined conversion to an 
image of a background region except an object domain or the object domain concerned concerned among 
the input images concerned 

[Claim 51] An image-processing method characterized by providing the following. An image input step A 
<TXF FR=0002 HE=250 WI=080 LX=1100 LY=0300> image-pick-up condition extract step An image 
transformation mode setting step A field extract step which asks for a predetermined object domain from 
an input image based on the image pick up conditions concerned or the image transformation mode 
concerned, and an image transformation step which performs predetermined conversion to an image of a 
background region except an object domain or the object domain concerned concerned among the input 
images concerned 

[Claim 52] Said image transformation step is the image -processing method according to claim 49, 50, or 
51 characterized by performing predetermined texture-mapping processing to said object domain based 
on said image pick-up conditions or said image transformation mode. 

[Claim 53] an image of others [ means / predetermined in said image transformation step / storage ] - 
inputting - said object domain - said image pick up conditions or said image transformation mode - 
being based - being concerned - others - an image-processing method according to claim 49, 50, or 51 
characterized by replacing by image. 

[Claim 54] Said image transformation step is the image -processing method according to claim 49, 50, or 
51 characterized by changing a specific color component of said object domain into other color components. 
[Claim 55] Said image transformation step is the image-processing method according to claim 49, 50, or 
51 characterized by performing predetermined geometric deformation to said object domain. 
[Claim 56] Said image transformation step is the image-processing method according to claim 49, 50, or 
51 characterized by adding predetermined watermark information to image data after conversion. 
[Claim 57] difference of a background image into which said field extract step was inputted beforehand, 
and said input image - an image -processing method according to claim 49 or 51 characterized by asking 
for said object domain based on data. 

[Claim 58] Said field extract step is the image -processing method according to claim 49 or 51 
characterized by providing a similarity detection step which detects similarity of a template model 
memorized by storage means and said input image, and a field extract step which extracts a field where 
the similarity concerned serves as beyond a predetermined threshold or the maximum. 
[Claim 59] Said image transformation step is the image -processing method according to claim 34, 35, or 
36 characterized by changing an intensity level or a color component value based on image pick-up 
conditions about a part of said object domain or said background region. 

[Claim 60] Said field extract step is the image -processing method according to claim 49 or 50 
characterized by what a boundary line of an extract field is superimposed on an input image, and is 
displayed on said image display means. 

[Claim 61] Said field setting step is the image -processing method according to claim 50 characterized by 
having a step which changes a location or size of the field concerned. 

[Claim 62] Said field extract step is the image -processing method according to claim 58 characterized by 
setting up a location and size in said input image of said template model image based on said image 
pick up conditions, and asking for a border line of said object domain by making a border line of the set up 



template model image concerned into an initial outline. 

[Claim 63] Said border-line display step is the image -processing method according to claim 50 
characterized by displaying said boundary line when a display action of a border line is chosen by 
predetermined display selection means. 

[Claim 64] A storage characterized by memorizing program software which performs an image-processing 
method according to claim 49. 
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DETAILED DESCRIPTION 



[Detailed Description of the Invention] 
[0001] 

[The technical field to which invention belongs] This invention relates to a storage at the image 
processing system and method list which have photographic subject logging and an image composition 
function. 
[0002] 

[Description of the Prior Art) With image pick-up equipment, as the flexibility of processing processing of 
image information improves with digitization of signal processing conventionally inside equipment From 
comparatively simple processing of conversion of an intensity level or a color tone, color balance 
adjustment, quantization size conversion, etc. Things which added the image-processing function, such as 
an edge extract function and a thing which has the photographic subject extract function (pp.13 - 1994 [ a 
television society technical report, Vol.18, / 18 or ]) of a color component using the grown method serially, 
are proposed variously. 

[0003] moreover, those difference after controlling light exposure in the method of extracting an image 
based on difference with a background image so that average luminance becomes proper at the time of the 
image pick-up of a background image and picturizing a subject-copy image using the same set point as a 
background image ~ the configuration which extracts an object image based on data is known (for 
example, refer to JP,6-253197,A). 

[0004] The technology shown below is known as the picture transmission which performs processing 
which is different from an input image to a specific region and other fields, or imaging technique. For 
example, it has the extract means of a specific object domain, and the technology of changing the coding 
property or transmission characteristic (the existence of transmission of a specific region being included.) 
etc. is indicated by JP,5-145914,A, JP,5-336374,A, JP,6-319130,A, JP, 7-222048, A, JP,7-230554,A, and 
JP, 7-2503 12, A by the image data of the portion which serves as image data of the field for [, such as a 
person, ] specification, and a background from an input image. 

[0005] Moreover, two or more fields are started from an image, the image transmission equipment 
equipped with a means to compound them by arrangement of arbitration is indicated by JP,7-298238,A, 
and the equipment which has a photographic subject extract means, the signal-processing 
parameter-control means about a photographic subject and a background or a processing circuit, and a 
substitute circuit is indicated by JP, 5- 110936, A, JP,6- 169425, A, JP,6-225328,A, and JP, 8- 154259, A. 
[0006] 



[Problem(s) to be Solved by the Invention] Since the conventional image processing system which has a 
photographic subject extract function aimed at carrying out the separation extract of the photographic 
subject under specific photography conditions, when it performed edit processing processing of images 
with the background prepared separately besides the trouble that it is difficult to extract a photographic 
subject for a general background, such as image composition, it had the following problems. That is, at 
the time of photography, it cannot judge whether the style of the photographic subject which carried out 
the separation extract suits the composition of a background image etc., and unless it is at the synthetic 
time, it is not known. Moreover, if whenever [ photography condition for example, lighting conditions 
exposure condition scale-factor, and focus ] etc. differ, by the way, it will be necessary to become very 
unnatural and a synthetic image with sense of incongruity, and to add processing of conversion of a color 
tone, or gradation amendment between the background image which the user prepared separately, and 
the extracted photographic subject image. 

[0007] This invention aims at showing the image processing system and method list which canceled such 
un arranging a storage. 

[0008] The conventional example of a publication does not tend to process some of those with a thing 
aiming at gathering coding effectiveness in an image pick-up system or a picture transmission system, 
and images into JP,5- 145914, A etc. 

[0009] The conventional example indicated by JP,7-298238,A extracts and compounds the rectangle field 
in an image, and cannot perform processing which specialized in the photographic subject portion of an 
arbitration configuration etc. 

[0010] The conventional example indicated by JP,5 110936,A and JP,6-225328,A sets up the range of 
brightness, a hue, or the color difference as an extraction condition, since it considers that the portion 
which fulfills this condition is a photographic subject, in the combination of the background color of 
arbitration, and a photographic subject, a desired photographic subject field cannot be extracted and 
processing processing of it cannot be carried out. 

[0011] Although a photographic subject is extracted in the video camera indicated by JP,6- 169425, A based 
on the color or the intensity level of a video signal of a photographic subject portion to which it 
superimposes on the image of a photographic subject, a marker is displayed on the predetermined 
location in the display screen of a viewfinder, and a marker is located in it, a user needs to adjust and 
photo a field angle so that a marker and a desired photographic subject may lap, and he is very 
troublesome, and operability is bad, therefore extract precision of a photographic subject is bad. 
[0012] By measuring a person's flesh color, JP,8* 154259, A presumes a person's existence region, extracts 
the person image, and lacks in versatility. 

[0013] Thus, it was difficult to perform semi automatically image processing of adding a predetermined 
shading off or deformation to the main photographic subject or the background of having an arbitration 
configuration in an image, or the color scheme of arbitration, in the conventional example by automatic or 
simple actuation. 

[0014] This invention aims at showing the image processing system and method list which cancel such 
un- arranging a storage. 

[0015] This invention aims at showing the image processing system and method list which make it 
possible to perform automatically or semi-automatically image processing of adding a predetermined 
shading off or deformation to the main photographic subject or the background of having an arbitration 



configuration in an image, or the color scheme of arbitration again a storage. 
[0016] 

[Means for Solving the Problem] An image processing system concerning this invention Image formation 
optical system, a photo-electric-conversion means, a video signal processing means, A directions selection 
means for making directions selection of the particular part of an image input means including a storage 
means and a control signal generating means, and an inputted image, It has an image display means in 
an image-processing means, an image coding means, an image recording means, and an image recording 
data-medium list. A specific photographic subject extract means to extract a specific photographic subject 
in an image using image information of a portion by which directions selection was made with a 
directions selection means in an image into which an image-processing means was inputted, It is 
characterized by having a background image memorized by a storage means or image recording data 
medium and a synthetic image generation means to compound this extracted specific photographic 
. subject. 

[0017] This inputs a photographic subject image including a background of arbitration (photography), and 
actuation with simple generating a synthetic image of a background image and a photographic subject 
which are different from a background in a photographic subject image after extracting a photographic 
subject in it can realize. Moreover, by displaying a compounded image on an image display means, a 
location and magnitude of a photographic subject in a synthetic image can be checked, and after a 
directions selection means adjusted them further and taking a background and suitable matching, a 
synthetic image can be recorded, saved or outputted. 

[0018] An image processing system concerning this invention Image formation optical system, a 
photo electric-conversion means, a video signal processing means, A directions selection means for 
making directions selection of the particular part of an image input means including a storage means and 
a control signal generating means, and an inputted image, It has an image display means in an 
image-processing means, an image coding means, an image recording means, a communications control 
means, and an image recording data-medium list. A specific photographic subject extract means to extract 
a specific photographic subject in an image using image information of a portion by which directions 
selection was made with a directions selection means in an image into which an image-processing means 
was inputted, It is characterized by having an input means of a background image through a 
communications control means, and a background image and a synthetic image generation means to 
compound an extracted specific photographic subject. 

[0019] Thereby, in addition to the above-mentioned feature, a background image is inputted from the 
outside, and actuation with simple composition with a photographic subject in a **** image and a 
photographic subject image including a background of arbitration can realize. 

[0020] In this invention, a control signal generating means inputs an auxiliary data about a configuration 
and a location of a specific photographic subject from a storage means, and it is characterized by 
displaying an auxiliary data on an image display means. By this, when a configuration or a style, a 
location, etc. of a photographic subject have become settled in general beforehand, by inputting the data 
(for example, border line of a rectangle frame or a photographic subject model same type etc.), and 
displaying on an input image in piles When a posture of a photographic subject in a photographic subject 
image etc. can be adjusted so that the auxiliary data may be suited in a site of image inputs, such as 
photography, activation of a body-ed extract is attained without performing partial assignment of an 



image for a photographic subject extract by directions selection means. 

[0021] In this invention, a control signal generating means inputs an auxiliary data about a configuration 
and a location of a specific photographic subject from a communications control means, and it is 
characterized by displaying an auxiliary data on an image display means. Thereby, in addition to said 
feature, an auxiliary data can be inputted from the outside of an image pick up image-processing means. 
[0022] An image processing system concerning this invention Image formation optical system, a 
photo-electric-conversion means, a video signal processing means, An image input means, an 
image-processing means including a storage means and a control signal generating means, It has an 
image display means in an image coding means to have an image format conversion means, an image 
recording means, and an image recording data-medium list. An image format conversion means within an 
image coding means An image memorized by a storage means or image recording data medium is 
changed into a predetermined format. An image coding means changes a format of predetermined image 
data recorded on a storage means or image recording data medium. An image -processing means It is 
characterized by performing specific photographic subject extract processing in an inputted image, and 
carrying out image composition of an extracted specific photographic subject image and the image by 
which format conversion was carried out with an image format conversion means. 

[0023] In an image-processing means equipped with a photographic subject extract which has by this the 
feature mentioned above, and an image composition processing facility, since a transform -processing 
means to a format suitable for image composition processing for the interior was built in, the selection 
range of a format of image data inputted can be extended sharply. 

[0024] An image processing system concerning this invention Image formation optical system, a 
photo electric-conversion means, a video signal processing means, An image input means, an 
image-processing means including a storage means and a control signal generating means, It has an 
image display means in an image coding means, an image recording means, and an image recording 
data-medium list. A control signal generating means has a photography condition measurement control 
means, and an image coding means encodes image data. Photography conditions are recorded on a record 
medium or a storage means in a predetermined format with encoded image data. It is characterized by an 
image -processing means compounding an image (background) which performed specific photographic 
subject extract processing in an inputted image, and was recorded on an extracted specific photographic 
subject, a storage means, or image recording data medium based on photography conditions. 
[0025] Thereby, after performing gray scale conversion etc. based on photography conditions, a natural 
synthetic image which lost an extracted difference among photography conditions of an image and a 
background image of a photographic subject is obtained automatically. 

[0026] In this invention, an auxiliary data is characterized by being a border line or mask data of 
predetermined size about a specific photographic subject. When a photographic subject configuration has 
become settled in general by this, a photographic subject extract can be automatically performed by 
obtaining a posture or a style of a photographic subject etc. which suited an auxiliary data in a site of an 
image input (photography), and extracting a field inside an auxiliary border line by displaying the border 
line or its contrant region on an input image in piles (special display of coloring etc.). Furthermore, when 
a background of a background image and a photographic subject image is mostly in agreement, precision 
of a photographic subject extract improves sharply. 

[0027] In this invention, an auxiliary data is characterized by being the close border line of a 



predetermined configuration. Even if it does not approximate a configuration of a photographic subject, as 
mentioned above, when a background of a background image and a photographic subject image is mostly 
in agreement, precision of a photographic subject extract improves sharply by specifying a photographic 
subject field with a very rough configuration given by close border lines, such as a rectangle reflecting the 
size in every direction, or an ellipse. 

[0028] In this invention, photography conditions are characterized by including a class and the direction 
of a look of light exposure or shutter speed, the amount of focuses, a photography scale factor, and 
illumination light. It is because a difference among these photography conditions is absorbed between a 
photographic subject image and a background image and a natural synthetic image is obtained. In 
addition, the direction of a look is used for assignment of a field that a photographic subject only exists etc. 
[0029] In this invention, an image -processing means performs synthetic processing of an image, after one 
image performs predetermined transform processing to some [ at least ] fields of an image based on a 
difference between photography conditions at the time of photography of an inputted image, and 
photography conditions of a background image so that while may carry out abbreviation coincidence with 
photography conditions of an image of another side. A natural image can be obtained, when one gradation, 
color tone, contrast, or sharpness of an image etc. is changed based on photography conditions and it 
compounds with an image of another side by this. 

[0030] In this invention, a control signal generating means inputs an auxiliary data about a configuration 
and a location of a specific photographic subject from a storage means, and is characterized by changing a 
configuration or a location of an auxiliary data based on photography conditions. Since the features (a 
configuration of a border line, contrast, etc.) of an auxiliary data can be automatically changed proper 
according to photography conditions of an input image even when [ from which photography conditions (a 
scale factor, lighting conditions exposure conditions etc.) when inputting a background image 
(photography) and photography conditions at the time of an input of a photographic subject image differ 
by this ] case or changing, it can simplify and subsequent photographic subject extract processing can be 
performed. 

[0031] A step into which an image-processing method concerning this invention inputs an image from a 
predetermined image input means, Measurement or a setting step of an image input condition of an 
inputted image, a step which records an image input condition on a predetermined storage means, A 
photographic subject extract step which extracts a specific photographic subject from an inputted image, 
an image composition step which compounds an image of a photographic subject extracted based on an 
image input condition, and a background image recorded on a predetermined storage means, It is 
characterized by consisting of an image output-control means step which performs an output to record or 
a predetermined display means by predetermined format for a predetermined storage means of a 
synthetic image obtained at an image composition step. 

[0032] Thereby, it is not concerned with a difference or fluctuation of an image input condition, but image 
composition with a specific photographic subject in a predetermined input image and a background image 
is made to a natural thing. Moreover, as long as the procedure is followed, image composition stabilized 
without being based on configuration is attained. 

[0033] This invention is characterized by to provide an image transformation means or a step which 
performs predetermined conversion to an image of a background region except an object domain or an 
object domain an image input means or a step, an image pick-up condition extract means or a step, an 



image transformation mode setting means or a step, a field extract means or a step that asks for a 
predetermined object domain using image pick-up conditions from an input image, and among input 
images. Thereby, a partial configuration of a photographic subject can certainly be specified from image 
pick-up conditions etc., and image pick-up equipment or a picture input device which can add and 
picturize desired conversion can be realized. 

[0034] This invention An image input means, an image display means, and an image pick up condition 
extract means, An image transformation mode setting means and a field setting means to set up a 
predetermined object domain based on the image transformation mode concerned or the image pick-up 
conditions concerned from an input image, It is characterized by providing a boundary layer display 
means to superimpose a boundary line of a setting field on an input image, and to display on an image 
display means, and an image transformation means to perform predetermined conversion to an image of 
a background region excluding an object domain or an object domain among input images. This invention 
is characterized by to provide an image input step, an image pick-up condition extract step, an 
image-transformation mode-setting step, the field setting step that sets up a predetermined object 
domain based on the image-transformation mode concerned or the image pick up conditions concerned 
from an input image, the boundary layer display step which superimposes a boundary line of a setting 
field on an input image, and display on an image-display means, and the image-transformation step 
which perform predetermined conversion to the image of the background region excluding an object 
domain or an object domain among input images. Photography from which a photographic subject is 
changed in a field which corresponds after checking by looking a field where a conversion field according 
to a photographic subject could be set up automatically, and a user was set up by this, or an image input 
which can check an image after conversion is realized. 

[0035] Moreover, this invention is characterized by to provide the image-transformation means or the 
step which performs predetermined conversion to the image of the background region excluding an object 
domain or an object domain among a field extract means or a step which asks for a predetermined object 
domain, and input images based on an image input means or a step, an image pick-up condition extract 
means or a step, an image-transformation mode-setting means or a step, and the image pick up 
conditions concerned or the image-transformation mode concerned. [ image / input ] An image input can 
be carried out, after being able to extract a field of a photographic subject from an image automatically 
based on image pick-up conditions etc. and changing a request to the extract field by this. 
[0036] In this invention, an image transformation means or a step is characterized by performing 
predetermined texture-mapping processing to an object domain based on image pick-up conditions or 
image transformation mode. Moreover, an image transformation means inputs other images from a 
predetermined storage means, and is characterized by changing an object domain by other images based 
on image pick up conditions or image transformation mode. By these, an image input means by which a 
specific region according to image pick up conditions or image transformation mode is convertible is 
offered. 

[0037] Moreover, an image transformation means or a step is characterized by changing a specific color 
component of an object domain into other color components. An image input means by which a color 
component of an object domain pinpointed using image pick up conditions etc. is automatically 
convertible by this is realizable. 

[0038] In this invention, an image transformation means or a step is characterized by performing 



predetermined geometric deformation to an object domain. An image input means by which geometric 
deformation of affine transformation etc. can be added to an object domain pinpointed using image 
pick-up conditions etc. by this is realizable. 

[0039] In this invention, it is characterized by an image transformation means or a step adding 
predetermined watermark information to image data after conversion. Thereby, information, such as a 
field for a transducer and a translation mode, is recordable in not being visually perceived with an image. 
Furthermore, after treatment of restoring an image before conversion based on such information can 
perform simply. 

[0040] difference of a background image and an input image into which a field extract means or a step 
was beforehand inputted in this invention - it is characterized by asking for an object domain based on 
data. Thereby, a field for conversion can be pinpointed automatically. 

[0041] In this invention, a field extract means is characterized by providing a field extract means to 
extract a field where similarity serves as a storage means of a predetermined template model image, and 
a similarity detection means of a template model and an input image with below a predetermined 
threshold or the maximum. A field extract step is characterized by providing a similarity detection step 
which detects similarity of a template model and an input image which are memorized by storage means, 
and a field extract step which extracts a field where similarity serves as below a predetermined threshold 
or the maximum. Thereby, while changing template size appropriately using image pick-up conditions 
etc., a picture input device which can pinpoint a field for conversion automatically as a high field of a 
template configuration and similarity is realizable. 

[0042] In this invention, an image transformation means or a step is characterized by performing 
conversion of an intensity level or a color component value based on image pick-up conditions about a part 
of object domain or background region. A picture input device which can specify and carry out image 
transformation of the portion which should be changed beforehand by this in a field pinpointed as a 
candidate for conversion is realizable. 

[0043] In this invention, a field extract means or a step is characterized by what a boundary line of an 
extract field is superimposed on an input image, and is displayed on said image display means. Thereby, a 
user can perform image transformation photography, after checking the range of an extracted field. 
[0044] In this invention, a field setting means or a step is characterized by having a location or a 
size -change means of a field. Conversion photography which can adjust set up a location or size of a 
conversion field simply by this can be performed. 

[0045] In this invention, a field extract means or a step sets up a location and size in an input image of a 
template model image based on image pick up conditions, and it is characterized by asking for a border 
line of an object domain by making a border line of a set-up template model image into an initial outline. 
Even if it is the photographic subject which has a border line which is somewhat different from a 
configuration specified with a template model by this, conversion photography which can perform image 
transformation automatically about a field inside a right border line is attained. 

[0046] In this invention, it is characterized by displaying the border line, when a display action of a 
border line is chosen by border-line display means or display selection means predetermined in a step. 
Thereby, conversion (or the reverse) in conversion photography mode from photography mode, a check for 
conversion, etc. can usually be performed. 
[0047] 



[Example] Hereafter, the example of this invention is explained to details with reference to a drawing. 
[0048] Drawing 1 shows outline configuration block drawing of the 1st example of this invention. The 
image formation optical system 12 in which the image pick-up image processing system 10 includes a 
taking lens and the drive controlling mechanism for zoom photography, an image sensor 14 like CCD 
series, the measurement control circuit 16 which measures and controls an image pick up parameter, the 
video signal processing circuit 18, storage 20, control of image pick-up actuation, Control of image pick-up 
conditions, The control signal of an image processing and an image output The control signal generating 
circuit 22, EVF to generate (Electronic view finder) etc. - in the directions selecting arrangement 26 
which consists of the display display 24, a pen mold key, or a cross-joint key etc. which makes a finder 
serve a double purpose, stroboscope luminescence equipment 28, a record medium 30, the image coding 
network 32, the image output circuit 34, the photographic subject extract circuit 36, and a list The image 
composition circuit 38 is provided. 

[0049] An image pick-up parameter measurement control circuit 18 possesses the control signal 
generating circuit which generates the control signal of video signal properties, such as a gamma property, 
a knee property, and color balance, in the light-exposure control circuit which controls the scale-factor 
detector which detects the scale factor of the zoom lens which can change a photography scale factor freely, 
the focus condition detector which detects the focus condition on the image pick-up side of an image 
sensor 14, the charge storage time of an image sensor 14, and/or the diameter of a opening of drawing of 
the image -formation optical system 12, a stroboscope luminescence control circuit, and a list. These parts 
are realized by software. An image pick up parameter includes the direction of a look, the existence of 
stroboscope luminescence, the classes (for example, daylight, a fluorescent lamp, an incandescent lamp, 
stroboscope light, etc.) of illumination light, etc. other than whenever [ photography scale -factor and 
focus ], and light exposure. The direction of a look is detected by the look detection equipment (not shown) 
built in the video signal processing circuit 18. 

[0050] The video signal processing circuit 18 has amendment circuits, such as gamma, a knee, and a 
white balance, an automatic focus (AF) circuit, an automatic-exposure-control (AE) circuit, an 
automatic-gain-control (AGO circuit, etc. 

[0051] The directions selecting arrangement 26 consists of a pen mold key, a cross- joint key, etc. However, 
the touch panel is united with the display display 24, and when the panel for actuation is displayed on the 
screen of the display display 24, the displayed panel for actuation becomes one gestalt of the directions 
selecting arrangement 26. 

[0052] A record medium 30 consists of various data medium, such as disk media, such as a magnetic tape, 
an optical disk, or a magneto-optic disk, a flash memory, and an IC memory. In this example, a record 
medium 30 is not limited to special data medium. A record medium 30 can be freely detached and 
attached to the image pick-up image processing system 10. 

[0053] The image coding network 32 carries out compression coding of the image data in a predetermined 
format with incidental data, such as photography conditions. 

[0054] With reference to drawing 2 , the extract of the photographic subject which is characteristic 
actuation of this example, and a synthetic process with a background image are explained. 
[0055] A user photos an image including the photographic subject which should be extracted (Si), and 
extracts the field image in which a photographic subject exists by the photographic subject extract circuit 
36 using the directions selecting arrangement 26 etc. (S2, S3). For example, several [ on the border line of 



the photographic subject of the input image displayed on the display display 24 ] are directed with the 
directions selecting arrangement 26, and the reference point of a photographic subject extract is set as the 
photographic subject extract circuit 36. The photographic subject extract circuit 36 performs an edge 
trace to which between adjacent data is connected by the predetermined method, and obtains the border 
line of the photographic subject as one closed curve. Edge data can be obtained space differential filtering 
processing of SOBEL, Laplacian, etc. by the well-known method to an input image. Thus, the image of the 
field inside the closed curve obtained is extracted as a photographic subject image (S3). The extract 
method of the closed curve equivalent to the outline of a photographic subject is not limited to the method 
mentioned above. 

[0056] Compression coding is carried out by the predetermined compression method (for example, 
compression coding method using a wavelet transformation, DCT conversion, etc.), and the image data of 
the extracted photographic subject field is stored in storage 20 in a predetermined format with 
photography conditions, such as a photography scale factor and exposure conditions (charge storage time 
of an image sensor, existence of stroboscope luminescence, etc.), (S4). 

[0057] Next, a background image is photoed or inputted (S5). The photographic subject image extracted 
previously is read from storage 20 or a record medium 30, displaying a background image (S6). The 
gradation and the color tone of a photographic subject image are adjusted (S7), and mixing with a 
background image and smoothing of a photographic subject near an outline are performed, and it 
compounds so that a photographic subject image may be overwritten at a background image, and displays 
on the screen of the display display 24 so that differences, such as gradation by the difference among the 
photography conditions between a background image and a photographic subject image and a color tone, 
may be controlled (S8). In order to gather the display speed of the display display 24, it may be made to 
perform amendment processing depending on photography conditions at the time of record of a synthetic 
image. 

[0058] Drawing 3 shows the example of the display screen of the display display 24. The photographic 
subject image display fields 40a, 40b, and 40c which display three photographic subject images obtained 
as a result of extract processing on the display display 24, The synthetic image display field 42, the 
expansion carbon button 44 which directs an enlarged display, the contraction carbon button 46 which 
directs a reduced display, the navigation key 48 which directs migration on four directions, return key 
which directs return to pretreatment 50a, and delivery key 50b which directs the next processing or 
subsequent ones are displayed. 

[0059] According to directions of a user, the location and size of a photographic subject image are adjusted 
(S9). At this time, the auxiliary frame 52 which expresses the size and the location of a photographic 
subject roughly is displayed to surround the photographic subject image on a synthetic image. 
Highlighting of the selected photographic subject image (image displayed on photographic subject image 
display field 40a in drawing 3 ) is carried out by **** etc. so that it may turn out to be it. Such an 
expression method is common knowledge. Drawing 4 shows the synthetic example which detached and 
added a little still more nearly same photographic subject image. Since a photographic subject image 
becomes large as a result, the auxiliary frame 52 in which the location and size of a photographic subject 
image are shown is larger than the case of drawing 3 . 

[0060] A user operates the expansion carbon button 44, the contraction carbon button 46, and the 
navigation key 48 for repositioning with a touch pen, a mouse, or a finger, and can change the size and the 



location of a photographic subject image. The graphical user interface using such carbon buttons itself is 
common knowledge. Although it is needless to say, such a manual operation button etc. may be set as the 
predetermined location on the surface of the main frame. It can return to a front processing phase by 
return carbon button 50a, and can shift to the next processing phase by stepper-button 50b. 
[0061] A user judges that it is in the suitable arrangement and the size in a background image the size of 
the extracted photographic subject image, and as a result of adjustment of a location, if a user pushes the 
synthetic record carbon button on a control panel, compression coding will be carried out and synthetic 
image data (of course, the auxiliary frame 52 is removed.) will be recorded on storage 20 or a record 
medium 30 (S10). In the case of this record, the photography conditions used for the synthetic image 
generate time may be encoded as incidental information, and you may record on the header unit of an 
image data file etc. As incidental information, parameters, such as the center of gravity location of the 
rectangle frame (for example, auxiliary frame 52 of drawing 3 ) circumscribed to the coordinate of each 
point on the border line of the photographic subject portion at the time of synthetic record and its border 
line other than photography conditions and size in every direction or a center-of gravity location of the 
ellipse circumscribed to the border line, size of the main shaft, a direction, and an ovality, may be included. 
[0062] Apart from a synthetic image, the incidental information about such a configuration of a 
photographic subject, a location, and size can be read by next photography, and can also be displayed on 
the display display 24 in piles as an auxiliary data at an image. By doing in this way, the time and effort 
which a photographic subject extract takes in a series of processings from the extract of a photographic 
subject to perform to composition with a background about a photographic subject of the same kind can be 
saved. 

[0063] After drawing 5 indicates the border line of an extract photographic subject image by superposition 
previously at a background image and adjusts the location and size of a photographic subject image, it 
shows the modification flow chart which compounded the photographic subject image. S11-S15 are the 
same as S1-S5 of drawing 2 . The border line of an extract photographic subject image is indicated by 
superposition at a background image (S16), and the location and size of a photographic subject image are 
adjusted (S17). Then, extract photographic subject image data and incidental information data are 
inputted, a photographic subject image is compounded to a background image, as it enters into a border 
line (S18) } a photographic subject image is amended according to photography conditions etc. (S19), and a 
synthetic image is recorded on a record medium 30 (S20). 

[0064] In addition, when the background in a background image and the photographic subject image 
before extract processing is performed is almost the same, even if the image field which should be 
extracted contains a part for a background to some extent, if it removes a changed part produced 
according to factors, such as a difference among photography conditions, it hardly poses a problem at the 
time of composition. Therefore, it cannot be overemphasized that in such a case a photographic subject 
may be roughly extracted and used including a background with a rectangle frame, an ellipse, etc. as 
mentioned above. 

[0065] Therefore, automatic extracting of the field which corresponds in the rectangle frame 54 of an 
applicable part when the image which removes an unnecessary person or an unnecessary body by 
photographic subject extract processing, and is obtained at the time of photography, i.e., the image with 
which a certain field was missing as shown in drawing 6 , is used as the 1st image, next a **** image is 
photoed may be carried out, and the 1st image may be compounded so that the image field for a 



background after removal may be filled up. Photographic subject image 40c of drawing 6 extracts the 
image in the rectangle frame 54, and is obtained. Also in this case, a synthetic result is displayed on a 
display means, and with directions of a user, a synthetic result image is encoded and it records on a 
predetermined record medium. 

[0066] Next, the 2nd example of this invention is explained. In the 2nd example, the image (the 1st image: 
don't ask an animation or a still picture.) prepared beforehand is captured through a record medium or 
means of communications of a main part etc. which can be detached and attached, and it compounds with 
the image (the 2nd image: don't ask an animation and a still picture.) photoed on the spot, and the 
synthetic image obtained as a result is recorded on the record medium or storage of a main part, or is 
outputted outside. Drawing 7 shows outline configuration block drawing of the example. The same sign is 
given to the same component as drawing 1 . As for the record medium which 140 can detach and attach 
freely, and 142, a communications control circuit and 144 are image data format conversion circuits. In 
case the image data format conversion circuit 144 changes into a predetermined content-type the image 
data of various formats inputted through communications control circuit 142 grade and outputs image 
data outside through the communications control circuit 142, it is changed into external predetermined 
format from a content- type. 

[0067] In this example, when the 1st image is a photographic subject image with which logging was 
already performed, the 1st image is compounded with the 2nd image (background image), without 
performing photographic subject extract processing mentioned above after the input of the 1st image. In 
addition, photographic subject extract processing may be performed to the 2nd image, and you may 
compound with the 1st image. 

[0068] As the gestalt of the image inputted from the outside through the communications control circuit 
142, and a class of image For example, a document image, a photograph, ete. of file format which were 
transmitted from the external terminal which goes via TV or a video image, the telephone line, etc., It is 
various, and although this example is not limited to either, data format presupposes that it is the image 
data transmitted to the list with other wireless or cables from image input devices (a digital camera, a 
scanner, FAX, etc.) a well-known thing. Similarly, what is necessary is just the thing of the format 
common knowledge of the classification of the image data recorded on a record medium 140. 
[0069] In this example, the data format which can be inputted is defined beforehand and a user chooses 
from them, the video signal with which coded-image data was treated as input data format, the 
classification was specifically judged at the time of an input (an automatic judging or manual judging by 
the user), and it was encoded [ DPCM ] - or the file format by which predetermined was encoded is 
identified. The image data by which run length coding was carried out [ MR / (MODIFAIDO lead) / DPCM 
coding or ] as a video signal, The thing of animation correspondences as a file format, such as MPEG and 
QuickTime (trademark of U.S. Apple Computer, Inc.), Bit map format, such as JPEG, TIFF, BMP/DIB, 
and GIF, PICT, PCX, It can incorporate with the data stream of the printer represented by 
three-dimension scene symbolic conventions for rendering applications, such as RIB, and PCL, and 
spreadsheet image formats, such as XLS, can be inputted into drawing data format, such as bit image 
format and other PPT, and a list. 

[0070] The inputted image data is decrypted, and after an error correction is carried out, a format is 
changed into it by the fixed format (bit map format, such as TIFF, BMP/DIB, or JPEG, is typical.) which 
suits an internal image processing if needed. 



[0071] The 1st image is a dynamic image, and when extracting a photographic subject from one of them 
and compounding with the 2nd image (background image), one frame which the user chose is changed 
into the data format of a static image. 

[0072] The 1st image is a dynamic image by which the photographic subject extract was already carried 
out, and in the case of animation format, the 2nd image also prepares the keying signal generating said 
way and the synthetic circuit as a part of image -processing means inside a main part, generates a keying 
signal about the photographic subject field in the 1st image in it, and may compound a photographic 
subject image (foreground image) and a background image to it with an animation. 

[0073] With reference to drawing 8 , the actuation and procedure of an example which are shown in 
drawing 7 are explained. First, a user chooses three kinds of one, a photography input, a communication 
link input, and a data-medium input, as image input mode of the 1st image (S21), stores in storage 20 the 
image inputted in the appointed image input mode (S22), and displays on the display disk play 24 (S23). 
While specifying a communication configuration or the source in a communication link input, inputting 
image data between 1 scheduled time or the number of fixed sheets by a predetermined protocol or a 
predetermined correspondence procedure and memorizing to storage 20, it displays on the display display 
24. In a data-medium input, a list of the record image of a record medium 140 is displayed, the image of 1 
or two or more requests is chosen as it from the inside, and it reads into storage 20. A display and 
selection of the image after taking a photograph also in a photography input are the same. 
[0074] A user chooses one suitable image frame or a series of dynamic-image frames from the image 
displayed on a display 24 (S24), and stores in storage 20 as the 1st image (S25). 

[0075] The photographic subject image which a user should use the directions selecting arrangement 26 
when photographic subject extract processing is not yet made to the 1st image, and he should extract 
from the 1st image is specified, and the photographic subject extractor 36 extracts a photographic subject 
image by the same processing as a previous example (S26). The location and size of a photographic subject 
image to a background image are adjusted (S27). At this time, it specifies whether a background image is 
overwritten and a photographic subject image is displayed or in order not to lower the display speed to 
the display display 24, only the border line of a photographic subject image is displayed on a background 
image in piles. A means for that is the same as that of the example explained previously, and is good. 
[0076] When the photography condition is attached to the photographic subject image and/or the 
background image as incidental information, like the 1st example, based on the difference among 
photography conditions, one gradation, color tone, etc. of an image are changed so that it may agree with 
the image of another side mostly (S28), a synthetic image is generated (S29), and it records on a record 
medium 140 (S30). 

[0077] In addition, when the class and exposure conditions of the illumination light are not attached to 
image data as photography conditions, it enables it for a manual to adjust gradation and/or a color tone 
(S31-33). Even if photography conditions are attached to image data, this can be used also when it cannot 
be satisfied with automatic amendment of gradation and a color tone. If the slide bar 150 for lightness 
conversion (or carbon button) and the slide bar 152 for saturation conversion (or carbon button) are 
displayed on a display panel and a user specifically operates which slide bar (or carbon button) 150, 152 so 
that it may be set as manual adjustment mode (S31) and may illustrate to drawing 9 , the color tone and 
contrast (or lightness and saturation) of a photographic subject image portion will be adjusted (S32). Of 
course, after specifying the particular part of a photographic subject, the color tone ete. can also be 



adjusted. If a user checks a synthetic result and inputs record directions (S33), a synthetic image will be 
recorded on a record medium 130 (S30). 

[0078] Thus, simple actuation can generate a natural synthetic image and it can record in the site of 
photography. 

[0079] In each above-mentioned example, you may record on storage 20 or a record medium 30,140 at the 
photographic subject border line obtained as an extract processing result of a photographic subject, or its 
border line by using as auxiliary border-line data the rectangle frame data which carries out abbreviation 
circumscription. As shown in drawing 10 , when the auxiliary outline display carbon button 154 is formed 
in a display panel and the carbon button 154 is pushed, the control signal generating circuit 22 reads the 
auxiliary border line data from storage 20 or a record medium 30,140, and makes an input image display 
in piles as an auxiliary border line 156 on the screen of the display display 24. The photographic subject 
image 158 surrounded by the auxiliary border line 156 does not need to be in agreement with 
photographic subject image 40c. 

[0080] If the set-up photography conditions (especially a photography scale factor, the direction of a look, 
etc.) are changed; this will be interlocked with and the size location and configuration of the auxiliary 
border line 156 will be changed automatically. In this case, if the size A of a proper is beforehand given to 
the photographic subject as incidental information, the size on the screen decided by photography 
conditions, such as a photography scale factor and photographic subject distance (it presumes from 
whenever [ focus ] etc.) of an outline, will be calculated, and the auxiliary border line 156 will be displayed 
on the display display 24 in the magnitude which suits that size. 

[0081] For example, in a focal distance, if distance from the 2nd principal point location of A and image 
formation optical system to an image sensor side is set [ the gap from the maximum of f and focus level ] 
to v for dp and the standard size of a photographic subject, the photographic subject size S on a screen will 
be given by the bottom formula, namely, - S=A(v£) (l+(v-f) dp/f)/f (l) 

However, fluctuation of photographic subject distance and fluctuation of focus signal level consider as 
linearity. Therefore, what is necessary is just to change the size of an auxiliary data according to 
scale-factor S/A based on a formula (l), if dp is measured and it asks for f from a lens location. 
[0082] Moreover, a user resets an auxiliary data as a suitable location using the directions selection 
means 26 if needed, and may correct the size ete. 

. [0083] The photographic subject extract technology used in the above-mentioned example is explained. 
Generally it indicates by setting in the suitable location on an input image by making an auxiliary border 
line (or mask data as field data inside an auxiliary border line) into an initial outline (or initial field), and 
the following photographic subject logging processings are performed by making it into an initial data. 
[0084] Specifically, the method of using a dynamic outline as the base is used (331 D.Terzopoul M.Kass, 
A.Witkin, os, "Snakes' Active Contour Models", International Journal of Computer Vision, pp.321- 1988). 
A dynamic outline method is a method of extracting an objective outline from edge information, and an 
initial border line is completed as the outline on a body by transforming a border-line model so that the 
energy performance index which meant as a constraint that an outline is smooth, that it was on an edge, 
etc. may serve as min. Moreover, it is based on a difference with the characteristic quantity of the image 
of the near field of for example, an initial outline, and the image about the local field of a photographic 
subject portion as concrete technique into which this was developed. The technique of making the inner 
sense or outward external force act on the point on the outline of a dynamic outline is known. (For 



example) R. Ronfard and "Region-Based Strategies for Active Contour Models" and International 
Journalof Computer Vision and pp.229- 251 and 1994 - and dynamic "outline extract based on 
description of field obtained from clustering" Institute of Electronics, Information and Communication 
Engineers paper magazine D-II besides Eito, vol.J75DII, and pp.1111- 1119, 1992, etc. 
[0085] Although especially the technique of image logging is not limited, an initial outline configuration is 
the method that logging can be performed, automatically in the conditions which approximate a 
photographic subject configuration well, and the above-mentioned method has it at this point. 
[ desirable ] 

[0086] Rough assignment (for example, a closed curve or a rectangle frame surrounding an object etc.) 
about the location and magnitude for logging may be performed, and you may record beforehand with an 
image as incidental data. After treatment performs image logging or image composition on other 
terminals after photography termination. Moreover, the image data inside a border line is extracted as it 
is, and it may compound with a background image and you may record. 

[0087] Drawing 11 shows outline configuration block drawing of the 3rd example of this invention. The 
image formation optical system 212 in which the image pick-up image processing system 210 includes a 
taking lens and the drive controlling mechanism for zoom photography, an image sensor 214 like CCD 
series, the measurement control circuit 216 which measures and controls an image pick-up parameter, 
the video signal processing circuit 218, storage 220, control of image pick up actuation, Control of image 
pick-up conditions, The control signal of an image processing and an image output The control circuit 222, 
EVF to generate (Electronic view finder) etc. - a finder The display display 224 made to serve a double 
purpose, a pen mold key Or photography mode setting equipment 240 is provided in the directions 
selecting arrangement 226 which consists of a cross-joint key etc., stroboscope luminescence equipment 
228, a record medium 230, the image coding network 232, the image output circuit 234, the photographic 
subject extract circuit 236, the image transformation circuit 238, and a list. 

[0088] Equipment 210 is divided into main part 210a and image-processing section 210b, the 
photographic subject extract circuit 236, the image transformation circuit 238, and display display 224b 
are held in image -processing section 210b, and you may make it hold the remainder in main part 210a, as 
shown in drawing 12 . 

[0089] The touch panel is united with the display display 224, and when the panel for actuation is 
displayed on the screen of the display display 224, the displayed panel for actuation becomes one gestalt 
of the directions selecting arrangement 226. 

[0090] A video signal processing circuit 218 possesses the control signal generating circuit which 
generates the control signal of video signal properties, such as a gamma property, a knee property, and 
color balance, in the light-exposure control circuit which controls the scale -factor detector which detects 
the scale factor of the zoom lens which can change a photography scale factor freely, the focus condition 
detector which detects the focus condition on the image pick up side of an image sensor 214, the charge 
storage time of an image sensor 214, and/or the diameter of a opening of drawing of the image-formation 
optical system 212, a stroboscope luminescence control circuit, and a list. These parts are realized by 
software. An image pick-up parameter includes the direction of a look, the existence of stroboscope 
luminescence, the classes (for example, daylight, a fluorescent lamp, an incandescent lamp, stroboscope 
light, etc.) of illumination light, etc. other than whenever [ photography scale-factor and focus ], and light 
exposure. The direction of a look is detected, by the look detection equipment (not shown) built in the 



image pick up image processing system 210. 

[0091] The video signal processing circuit 218 has amendment circuits, such as gamma, a knee, and a 
white balance, an automatic focus (AF) circuit, an automatic-exposure-control (AE) circuit, an 
automatic gain-control (AGO circuit, etc. 

[0092] Storage 220 becomes ROM and the list which store the processing program used for a frame buffer, 
a Video RAM, the template data used for conversion photography, and image transformation from other 
primary storage means. 

[0093] A record medium 230 consists of various data medium, such as disk media, such as a magnetic tape, 
an optical disk, or a magneto-optic disk, a flash memory, and an IC memory. In this example, a record 
medium 230 is not limited to special data medium. A record medium 230 can be freely detached and 
attached to the image pick up image processing system 210. 

[0094] The image coding network 232 carries out compression coding of the image data in a 
predetermined format with incidental data, such as photography conditions. 

[0095] In this example, a request can be automatically processed in a photography image at the time of 
photography. This is called conversion photography mode on these specifications, conversion photography 
mode - bloodshot-eyes amendment mode, mustached removal mode, and silverfish - there is 
removal/addition mode of a freckle etc. About size, a location, etc. in the screen of a photographic subject, 
if it is selectable and there is no assignment from a user especially at this example about the 2 of 
automatic detection mode and manual setting mode modes to one, as for a user, automatic detection mode 
shall be set up. 

[0096] In this example, it shall record and prepare for storage 220 or image recording data medium 230 
beforehand at the model border line belonging to a photographic subject category, or its border line by 
using as auxiliary border-line data the border line coordinate data of the frame of the predetermined 
configurations (a rectangle or ellipse) which carry out abbreviation circumscription. Moreover, what 
consists of a partial border line showing the category for an extract of a configuration as a model border 
line, for example, the model which consists of a partial feature element indicated by JP, 7-320086, A by the 
same applicant as this application, may be used. 

[0097] The auxiliary border-line (above-mentioned model border line) data which has the size set up by 
the method of mention later based on photography conditions, such as a scale factor and photographic 
subject distance, is scanned sequentially from the edge on a screen, whenever [ with the edge intensity 
distribution of an input image / coincidence ] (for example, correlation value) is evaluated in automatic 
detection mode in each location, and it asks for the maximum location of whenever [ coincidence ] as an 
optimal location. Thus, even if it is a case as two or more extract object domains are included, automatic 
activation of two or more detection and field extracts of the location of a photographic subject field can be 
carried out. 

[0098] The contents of each translation mode are explained briefly, mustached removal (addition) mode 
and silverfish - in freckle removal mode, a person's head or face is first detected from an input image. 
[0099] It is good by the method of detecting the location where a standard template image (a shade image 
or color picture) is used for others, it is changed into suitable size as detection processing of a face or an 
eye based on photography conditions, a correlation value is calculated [ location ] in each location in an 
image, and correlation serves as max or the maximum. 

[0100] in manual setting mode, a control circuit 222 is shown below - as - auxiliary border lines (border 



line of the face displayed with a closed curve etc.) ■ the screen top of a display 224 displaying the 
inside of the auxiliary border line - outline ****** like, a user adjusts image pick-up conditions, such as 
a scale factor and a line of sight, or the location and size of an auxiliary border line are changed. 
[0101] In the bloodshot-eyes amendment in automatic detection mode, the eye in an input image is 
detected and the pixel equivalent to bloodshot eyes is alternatively changed into black etc. The details of 
this processing are mentioned later. I display on the screen of a display 224 by making the model border 
line (both eyes or one eye) of an eye into an auxiliary border line, and have a user set up image pick-up 
conditions in manual setting mode. 

[0102] In mustached removal mode, the beige component of a face is extracted after detection of a face 
field, and the field pixel of black or off-white is changed beige except for the hair in a face in the field to 
which a mustache may exist. 

[0103] silverfish - in freckle removal mode, the representation color component value of the beige 
component of a face is extracted after detection of a face field, and the pixel value of the field which has an m 
especially different color component from a beige representation color component value in each field of a 
cheek, a jaw, and a frame in a face is changed into the color component value of a representation color. 
[0104] Each above mode changes the particular part of a photographic subject, and it is necessary to 
pinpoint the range for conversion in a high precision. With reference to drawing 13 , the details of the 
extract process of a photographic subject field and the image transformation process of a photographic 
subject portion are explained. 

[0105] A user sets up conversion photography mode with photography mode setting equipment 240 first 
(S41). An image including the photographic subject set as the object of conversion is photoed after 
conversion photography mode setting (S42), and automatic detection mode or manual setting mode is 
distinguished (S43). 

[0106] In the case of manual setting mode (S43), the location where a photographic subject exists with the 
photographic subject extractor 236 using the directions selecting arrangement 226 etc. is specified (S44). 
For example, in using a pen type thing as a directions selecting arrangement 2269, it directs the point 
equivalent to the reference points (center of a face etc.) of the photographic subject of the input image 
displayed on the display display 224 with the pen. It is good also considering the location of the direction 
of a look which detects with a look detection means and is acquired as a reference point. 
[0107] in the case of automatic detection mode (S43), it is shown in ( drawing 14 as ••) a control circuit 
222 reads auxiliary border-line data from storage 220 or a record medium 230 (S45). Furthermore, the 
auxiliary border line 250 ( drawing 14 ) may be displayed on an input image in piles centering on a 
reference point location on the screen of the display display 224. This display action may be made to be 
started by pushing the carbon button 248 ( drawing 14 ) for an auxiliary outline display. As mentioned 
above, this auxiliary border line is a border line of the face expressed with a closed curve etc., and shows 
the outline configuration of the field which should be changed etc. That is, it differs from the marker who 
only shows the target location. 

[0108] Corresponding to the set-up photography conditions (especially a scale factor, the direction of a 
look, etc.), according to the fluctuation, a control circuit 222 is set up automatically and changes the size, 
location, or configuration of auxiliary border line data (S46). In this case, the size A of a proper shall be 
beforehand given to the photographic subject as incidental information, and a control circuit 222 
calculates the auxiliary-data size on a screen from photography conditions, such as a scale factor and 



photographic subject distance (from whenever [ focus ] etc. to presumption) of an outline, changes it into 
suitable size, and is displayed on the display display 224 as a close border line. For example, in a focal 
distance, if distance from the second principal point location of A and image formation optical system to 
the image pick up side of an image sensor 2 14 is set [ the gap from the maximum of f and focus level ] to v 
for dp and the standard size of a photographic subject, the photographic subject size S on a screen will be 
given by the following formula, namely, - S=A(v-f) U+(v-f) dp/f}/f (2) 

However, suppose that fluctuation of photographic subject distance and fluctuation of focus signal level 
are linearity. 

[0109] Therefore, what is necessary is just to change the size of an auxiliary data by measuring dp and 
asking for f by lens location measurement etc. according to scale-factor S/A based on a formula (2). It 
cannot be overemphasized that photographic subject distance may be presumed with other means (for 
example, ranging means using a laser beam etc.). 

[0110] The photographic subject extractor 236 makes an auxiliary border line (or mask data as field data 
inside an auxiliary border line) an initial outline (initial field), sets it as the suitable location on an input 
image, and performs extract processing of a photographic subject field by making it into an initial data 
(S47). However, when manual setting mode is chosen, the set-up interior of an auxiliary border line is 
extracted as a photographic subject field. When for example, bloodshot-eyes amendment mode is set up as 
photography mode, the rectangle which includes the both eyes of the portrait image corresponding to the 
configuration border-line model or standard photography distance of both eyes as an auxiliary border line, 
and has size comparable as the gap of both eyes is used. 

[0111] In this example, the method which made ** SU the dynamic outline method indicated by 
JP,9 185719,Aby the same applicant as this application is used. A dynamic outline method is the method 
of completing it as the outline on a body by transforming a border-line model so that a border-line model 
(initial outline: it is equivalent to an auxiliary border line in this example.) may be given and the energy 
performance index which meant as a constraint that it was on that an outline configuration is smooth and 
an edge etc. may serve as min. 

[0112] Since outline coincidence of an auxiliary border line and the border line of the photographic subject 
which should be extracted can be automatically carried out by changing the size about an auxiliary 
border line etc. based on image pick up conditions, the photographic subject field by the complexity of the 
image pattern for a background and the complexity of a photographic subject configuration which should 
be changed ** can be extracted to a high speed and stability. 

[0113] Thus, after extracting the field inside the border line (closed curve) obtained automatically as a 
photographic subject field, in a photographic subject field, T and binary mask data which are set to , 0' 
except [ its ] are generated. Image transformation equipment 238 performs transform processing 
according to conversion photography mode to the image belonging to a mask field (for example, a mask 
value is the field of T) (S48). 

[0114] For example, when bloodshot-eyes amendment mode is set up as photography mode, 
bloodshot-eyes amendment processing is performed to the pixel of the red component of the extracted 
field. As shown in drawing 15 , it searches for the pixel which contains many red components which are 
specific colors in a mask field (S61), and, specifically, the connection field is extracted (S62). And it is a 
field contiguous to the connection field, a representation color component is extracted from the set of the 
pixel which is within the limits of planned color components, such as black or tea, (S63), and the color 



component value of the corresponding pixel is changed into representation colors (black etc.) (S64). It is 
the pixel which does not define beforehand the color component value permitted as a representation color, 
but is near the corresponding pixel, and although it has the color component value of non-red and 
non-white, color component values (for example, brown, blue, or a golden component etc.) may be used. 
You may change uniformly so that it may have the color component value beforehand set up in the red 
component pixel in a mask field, without extracting a connection field. 

[0115] bloodshot-eyes amendment mode and silverfish - an example of the automatic processing (it 
corresponds to extract processing of the field which should be pinpointed by S47 of drawing 13 .) which 
can pinpoint the field for the transducer used in common with freckle removal mode, mustached removal 
mode, etc. is explained with reference to drawing 16 . Here, an auxiliary border line shall be given as a 
target border-fine model which should be changed, and as mentioned above, based on image pick up 
conditions, such as a scale factor and photographic subject distance, a scaling shall be made beforehand. 
[0116] First, the point which corresponds as the focus of a border line model to one of classification, such 
as the point of inflection, a corner, and the curvature maximum point, is extracted (S7l), and each 
classification and location are recorded. This data may be beforehand given as incidental data of a 
border-line model. 

[0117] The edge intensity distribution of an input image are searched for by filtering accompanied by 
space derivation, such as Sobel, Prewitt, or Canny, (S72). The acquired edge intensity distribution are 
made binary with a predetermined threshold, processing of the maximum location trace of thinning or 
edge intensity distribution etc. is added if needed, and border-line data is extracted (S73). 
[0118] The focus (and the classification) is detected like model data from the extracted border fine (S74), 
between the focus between both border lines data is matched (S75), and the location gap vector between 
corresponding points is extracted (S76). Since this location gap vector gives the relative displacement 
centering on a center of gravity, that amount of offset is made to serve as zero, and it normalizes (S76). 
[0119] The displacement corresponding to location gap vector quantity is given to each focus (S77), spline 
interpolation etc. generates the curve which connects between the focus adjoined after migration, and a 
border-fine model is transformed (S78). 

[0120] It cannot be overemphasized that matching between curves is not limited to the method mentioned 
above, and other methods may be used. 

[0121] Thus, it is the pinpointed field which is obtained and where the field inside the border line (closed 
curve) of the border-line model which deformed is set as the object of image transformation. Furthermore, 
you may amend using other technique, such as a dynamic outline method, if needed. Desired image 
transformation is automatically performed to a photography image (output image of an image sensor 214) 
** [ according to / the complexity of the configuration of a portion to be changed etc. ] by above-mentioned 
matching processing and pinpointing of a deformation field. 

[0122] After above photographic subject field extracts and image transformation processings, a coding 
network 232 carries out compression coding of the image after conversion (S50), and records on a record 
medium 230 (S5l). The image output signal generating circuit 234 generates and outputs video signals 
(NTSC system or PAL system) from the image after conversion simultaneous in be fastidious (S52). 
[0123] In the graphics format outputted from a coding network 232, incidental information, such as image 
pick-up conditions, photography time, compressibility, and a compression method, is recorded on a header 
or the incidental information data file created separately by the existence of activation of image 



transformation, conversion photography mode, a conversion location, auxiliary border-line data, and the 
list if needed, for example. An example of the expression method about the record format of these items is 
shown in drawing 17 . 

[0124] Incidental information may record on an image that it cannot perceive visually as electronic 
watermark data (Proc of the IEEE, vol.83, pp.944-957.1995). For example, the least significant bit 
showing image data is assigned as a write-in bit of these data, and there are methods, such as embedding 
into the edge portion in an image. In this case, especially the border line for a transducer can be 
superimposed and recorded on image data. 

[0125] In this example, photographic subject image 242c used as the photographic subject 252 of drawing 
14 and the model for an extract does not necessarily need to be in agreement. It is because it can ask for 
the border line of a right photographic subject by a dynamic outline method etc. 

[0126] Although image transformation was performed to the extracted object domain in this example, it 
cannot be overemphasized that image transformation may be carried out to reverse at a part for the 
background. This is the same also about the following examples. 

[0127] With the configuration shown in drawing 12 , image pick up conditions, image data, a model 
border line, etc. may be supplied to the photographic subject extract circuit 236 after photography, image 
pick up conditions may be utilized, and image transformation which asked for and mentioned the 
conversion field above may be performed. In this case, image -processing section 210b separated from 
main part 210a is realizable by computer. The function of the photographic subject extract circuit 236 and 
the image transformation circuit 238 is realized by the program of the procedure shown in drawing 13 , 
drawing 15 , etc. 

[0128] Next, the example which performs geometric transform processing or substitute processing to the 
predetermined image portion set up or extracted by the method shown in the above-mentioned example to 
the input image is explained. The flow chart of an overall procedure is shown in drawing 13 . Drawing 18 
is the same as the processing flow fundamentally shown in drawing drawing 13 except for a setup in 
conversion photography mode. 

[0129] the target transform processing (S89 of drawing 18 ) be substitute processing to the parts image 
data by which each part be beforehand prepared for deformation of each part, such as processing which 
fatten or dwindle an image field about the parts (an arm, leg, etc.) of for example, hairstyle, conversion, 
mustached addition conversion, facial form conversion, portraitizing, a face, or the body or all the bodies, 
an eye which be the component of a face, a nose, and opening, or modification of the geometry between 
each part, and a list etc. 

[0130] In this example, the type which set up conversion photography mode (S8l), and set up that degree 
after that with the classification of conversion which was mentioned above, or was further subdivided of 
the same conversion categories is chosen (S82). 

[0131] The photographic subject field used as the candidate for conversion is extracted (S 88), and 
transform processing which suits the configuration for conversion well is performed after that using the 
size of image pick-up conditions or an extract field etc. (S89). 

{0132] A mustached addition translation mode is the so-called processing which carries out texture 
mapping (see the "ray-tracing" OhnrSha ** written by Shin-ichi Takemura) about the image data of the 
preselected mustache in the predetermined location of the face in an image. An example of a selection 
screen mustached type when the conversion photography mode of mustached addition is set as drawing 



12 is shown. A list of the mustached image according to type is displayed, and a user chooses one of them 
using the directions selecting arrangement 240. For example, the frame which surrounds an image using 
a cross-joint key is moved, and a non-illustrated confirmation button is pushed and chosen. The input 
image is displayed on the subwindow at the lower right of a screen. If the 'following* carbon button 
displayed on a screen is pushed after choosing a mustached type, as shown in drawing 20 , a processing 
result will be displayed on a display. When a user pushes a confirmation button etc., finally conversion 
photography (the video signal of an resolution picture is outputted [ encoding an resolution picture and 
recording on a record medium ] to the exterior) is completed. The texture data of a mustached image is 
performed as mustached texture mapping is mapped by suitable size and a suitable location using the 
configuration of a formula (2) and an extract field. 

[0133] In a facial form translation mode, so-called morphing or substitute between the face image data 
which should serve as a face image in an input image and a target etc. is performed. Facial form 
conversion is automatically performed using the model which consists of a partial feature element 
indicated by JP, 7- 320086, A by the same applicant as this application by taking correspondence between 
each part articles (an eye, a nose, opening, etc.) of the face of an input image and a target image. In this 
case, as the above-mentioned example explained, after the face image of a target is changed into suitable 
size by the automatic scaling based on image pick-up conditions, processing of morphing, substitute, etc. 
is performed. 

[0134] the sketch model data (being the so-called ■-) of the face currently beforehand prepared in the 
portrait ized mode after detecting a face field Carry out an automatic scaling, as the template model was 
explained previously, and correspondence is taken between the edge intensity distribution of the face field 
of an input image, and the components of the face of a sketch model. Furthermore, the movement 
magnitude from the model data of the arrangement between components (each center- of- gravity location 
etc.) and the deformation of each part article are amplified to linearity or non-linearity, and the fixtures of 
a face are exaggerated. Thereby the line drawing image of the portrait-ized face is generated. 
[0135] In the above transform processing, in order to detect the location of conversion object domains (face 
field etc.) The model border-line data (face etc.) for conversion is inputted from storage the same with 
having explained with reference to drawing 13 or subsequent ones. What is necessary is to scan in an 
image what changed this into suitable size using image pick up conditions by the formula (2) etc., and 
just to ask for the location where a correlation value with the border line for which it asked from the edge 
intensity distribution of an input image serves as max (or maximum). 

[0136] An example of the processing flow which generalized pretreatment of these transform processing is 
shown in drawing 21 . A template model is changed into suitable size based on image pick-up conditions 
(a scale factor, photographic subject distance, the direction of a look, etc.) (S101), and point of inflection, a 
corner, the curvature maximum point, etc. on the border-fine data are extracted as the focus of a template 
model, or focus data is read from storage as incidental information on template model data (S102). The 
edge intensity distribution of an input image are extracted (S103), binary izing, a border line extract, etc. 
are performed (S104), and the focus extracted with the template model and the same focus are searched 
for and extracted (S105). 

[0137] Between the focus is matched (S106). Thereby, between the components which constitute faces, 
such as an eye, a nose, and opening, can be matched. That is, since the center-of-gravity location and size 
on the image of a template model are beforehand set up appropriately based on image pick-up conditions 



etc., they can search for and detect the focus which corresponds in the near range for every focus in an 
input image for every focus on each part articles (an eye, a nose, opening, etc.) in a template model. 
[0138] The location gap vector between corresponding points is extracted, and it normalizes on the basis 
of a eenter-of-gravity location (S107). Various image transformation is performed based on this result 
(S108). 

[0139] A face field makes it become thin (making it grow fat), and deformation processing of conversion 
object domains (face image field etc.) is explained to an example for processing. A face makes it become 
thin and processing is variable power conversion (affine transformation) to which longitudinal 
magnification sets lateral magnification to a (it is 0< a<l here) to 1 about the field inside a border line. It 
is made to grow fat and is set to a> 1 in processing. 

[0140] After the location (reference point locations, such as a center of gravity) of a face field is detected, it 
asks by the method of showing the border line in drawing 16 . A face dwindles drawing 22 and it shows an 
example before and behind conversion of processing. It is made to become thin and a crevice occurs 
between parts for the face worn thin and a background in conversion photography. The image data of this 
gap portion is the following, and is made and generated. That is, the color component value or texture 
pattern of image data for a background which adjoins each border line of the face field in the original 
image is extracted, and the color component value of the adjoining portion is given to the pixel of an 
applicable portion, or the texture pattern of an adjoining field is mapped. The image of the whole 
background is photoed beforehand and the corresponding background image may replace a gap portion. 
[0141] it is made to grow fat and a conversion object domain is **** in the background region of the 
original image data at processing at reverse - what is necessary is just to interpolate the image data 
inside the border line of the field after conversion by the affine transformation image data of the original 
portion for conversion, although it becomes ****** 

[0142] When replacing by other face images as other transform processing While other target images 
changed into the template size set up as the image field for conversion was mentioned above replace A 
face dwindles fields, such as a gap portion (refer to drawing 22 (2)) produced when a configuration is not 
in agreement, and background-image data is inserted in them by extrapolation of texture mapping or a 
color component etc. like the case of processing. 

[0143] In performing portraitization, while being able to give and predetermined maximum-amplify the 
rate of exaggeration showing the degree of exaggeration of the location gap vector between the extracted 
each part articles, it divides (inch-between), and transforms the border line data of the original template 
model by linearity extrapolation, such as law. For example, based on the template model which consists of 
a partial feature element indicated by JP,7 320086,A by the same applicant as this application, it asks for 
the new location of each focus of each partial feature element by linearity extrapolation, and the curve 
which ties smoothly the new partial feature element obtained as a result is generated. Thereby, the 
portraitized face image is called for. 

[0144] It can save with the border-line data of the object domain after also changing the original image 
data of the field used as the candidate for conversion on the occasion of coding and record of the image 
after conversion. Thereby, when required later, processors, such as a computer, can be used and the 
original image data can be restored easily. The partial image of the object domain before changing into a 
file separate from the image data file after conversion as the record gestalt may be recorded, or you may 
record on a part for the header unit of the image data file after conversion. In generating the partial 



image data file before conversion, it records the image data file name after changing into the header unit 
etc. 

[0145] The background image is photoed beforehand, the target field is extracted based on the difference 
of the background image and the input image containing the candidate for conversion, and it may be 
made to perform image transformation which a user specifies as the field. Here, image pick-up equipment 
shall be used by the stock photography which is not fixed to a tripod etc., and makes it a prerequisite for a 
focus to differ from exposure conditions etc. in the time of background-image photography and the input 
image photography including a photographic subject, a pin - and/or, processing becomes easier when 
exposure conditions are in agreement. 

[0146] The extract of an object domain and the flow chart of a transform -processing process are shown in 
a photography actuation list at drawing 23 . 

[0147] A background image is photoed (Sill), the image pick up conditions at this time are extracted 
(S125), and it memorizes to storage 220 etc. Conversion photography mode is set up (S112) and 
conversion targets (a hairstyle, a mustache type, facial form, etc.) and the degree of conversion are 
specified if needed (S113). A photographic subject image (input image in a previous example) is photoed 
(S114), the image pick up conditions at this time are also extracted (S126), and it memorizes to storage 
220. 

[0148] Then, in order to extract the corresponding points between a background image and an input 
image (S115) and to remove the effect of stock photography therefore the rotation to produce, a parallel 
displacement, scale-factor fluctuation, etc., the geometric conversion parameter (affine transformation or 
transparent transformation parameter) of the background image in consideration of the difference among 
the image pick-up conditions between corresponding-points extract data and an image is presumed and 
extracted (S116). By taking into consideration the difference among image pick-up conditions, the 
incorrect correspondence in corresponding-points extract processing is removed, and geometric 
conversion in a high precision is enabled (S117). 

[0149] It asks for a gray- scale -conversion parameter in consideration of a difference of image pick-up 
conditions, such as a pixel value between corresponding points and exposure conditions, and the 
gradation of a background image is changed (S118). Specifically with reference to the pixel values 
between corresponding points (RGB each color component value etc.), the pixel value translation table 
from a background image to the corresponding points of an input image to each gradation in 0 to 255 level 
is presumed. In consideration of photography conditions (exposure conditions etc.), much more 
high-degree-of-accuracy-ization can be attained by eliminating the pixel value data of incongruent 
corresponding points in the amount of fluctuation of image pick up conditions clearly in that case. 
[0150] Thus, the difference of the background image and input image which were changed is taken, and a 
photographic subject field is extracted by processing of making it binary with a predetermined threshold 
(S119). Since future processings are the same as the case of drawing 18 , detailed explanation is omitted. 
[0151] 

[Effect of the Invention] As explained above, according to this invention, in a set photograph, a 
commemorative photo, or a catalog photograph, the natural synthetic image into which the person or 
body which does not exist on that occasion was put is set by the composition and the photography 
conditions of a site, and simple actuation generates it, and it can be recorded in a photography site. 
[0152] By using the auxiliary border line about a configuration, size, etc. of a photographic subject which 



were recorded beforehand, if it is the same background, photographic subject extract and synthetic image 
generation can be automatically performed only by using the image in an auxiliary border line. 
[0153] When removal of an unnecessary person or an unnecessary body is not depended on the complexity 
of the configuration, either but photos the image of only a background, it can remove easily and fitting for 
the background equivalent to the portion after removal can be performed by simple actuation. 
[0154] According to this invention, moreover, the main photographic subject image portion which has the 
configuration of arbitration in an image input means by using image pick-up conditions at the time of an 
image pick up (at the time of an image input) or the background-image portion except the main 
photographic subject Specify with a sufficient precision, without being influenced by an image pattern, 
lighting conditions, etc. of a background, the automatic (semi- automatic) conversion photography which 
performs conversion or processing processing of arbitration to an applicable portion is attained, and the 
image which performed such conversion can be recorded or transmitted. 

[0155] Moreover, since a model border line can be set as the suitable location in an image with reference 
to photography conditions, a high speed and the field of a portion which is automatic and serves as a 
candidate for conversion can be extracted from an image, and desired conversion photography can be 
performed. 



[Translation done.] 
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DETAILED DESCRIPTION 



[Detailed Description of the Invention] 
[0001] 

[The technical field to which invention belongs] This invention relates to a storage at the image 
processing system and method list which have photographic subject logging and an image composition 
function. 
[0002] 

[Description of the Prior Art] With image pick up equipment, as the flexibility of processing processing of 
image information improves with digitization of signal processing conventionally inside equipment From 
comparatively simple processing of conversion of an intensity level or a color tone, color balance 
adjustment, quantization size conversion, etc. Things which added the image-processing function, such as 
an edge extract function and a thing which has the photographic subject extract function (pp.13 ; 1994 [ a 
television society technical report, Vol.18, / 18 or ]) of a color component using the grown method serially, 
are proposed variously. 

[0003] moreover, those difference after controlling light exposure in the method of extracting an image 
based on difference with a background image so that average luminance becomes proper at the time of the 
image pick up of a background image and picturizing a subject-copy image using the same set point as a 
background image - the configuration which extracts an object image based on data is known (for 
example, refer to JP,6-253197,A). 

[0004] The technology shown below is known as the picture transmission which performs processing 
which is different from an input image to a specific region and other fields, or imaging technique. For 
example, it has the extract means of a specific object domain, and the technology of changing the coding 
property or transmission characteristic (the existence of transmission of a specific region being included.) 
etc. is indicated by JP,5145914,A, JP,5 336374,A, JP,6-319130,A, JP, 7 -222048, A, JP,7230554,A, and 
JP,7-250312,A by the image data of the portion which serves as image data of the field for [, such as a 
person, ] specification, and a background from an input image. 

[0005] Moreover, two or more fields are started from an image, the image transmission equipment 
equipped with a means to compound them by arrangement of arbitration is indicated by JP,7-298238,A, 
and the equipment which has a photographic subject extract means, the signal-processing 
parameter-control means about a photographic subject and a background or a processing circuit, and a 
substitute circuit is indicated by JP,5 110936,A, JP,6- 169425, A, JP,6-225328,A, and JP,8- 154259, A. 
[0006] 



[Problem(s) to be Solved by the Invention] Since the conventional image processing system which has a 
photographic subject extract function aimed at carrying out the separation extract of the photographic 
subject under specific photography conditions, when it performed edit processing processing of images 
with the background prepared separately besides the trouble that it is difficult to extract a photographic 
subject for a general background, such as image composition, it had the following problems. That is, at 
the time of photography, it cannot judge whether the style of the photographic subject which carried out 
the separation extract suits the composition of a background image etc., and unless it is at the synthetic 
time, it is not known. Moreover, if whenever [ photography condition for example, lighting conditions 
exposure condition scale-factor, and focus ] etc. differ, by the way, it will be necessary to become very 
unnatural and a synthetic image with sense of incongruity, and to add processing of conversion of a color 
tone, or gradation amendment between the background image which the user prepared separately, and 
the extracted photographic subject image. 

[0007] This invention aims at showing the image processing system and method list which canceled such 
un-arranging a storage. 

[0008] The conventional example of a publication does not tend to process some of those with a thing 
aiming at gathering coding effectiveness in an image pick up system or a picture transmission system, 
and images into JP,5- 145914, A etc. 

[0009] The conventional example indicated by JP,7-298238,A extracts and compounds the rectangle field 
in an image, and cannot perform processing which specialized in the photographic subject portion of an 
arbitration configuration etc. 

[0010] The conventional example indicated by JP,5 110936,A and JP,6-225328,A sets up the range of 
brightness, a hue, or the color difference as an extraction condition, since it considers that the portion 
which fulfills this condition is a photographic subject, in the combination of the background color of 
arbitration, and a photographic subject, a desired photographic subject field cannot be extracted and 
processing processing of it cannot be carried out. 

[0011] Although a photographic subject is extracted in the video camera indicated by JP,6- 169425, A based 
on the color or the intensity level of a video signal of a photographic subject portion to which it 
superimposes on the image of a photographic subject, a marker is displayed on the predetermined 
location in the display screen of a viewfinder, and a marker is located in it, a user needs to adjust and 
photo a field angle so that a marker and a desired photographic subject may lap, and he is very 
troublesome, and operability is bad, therefore extract precision of a photographic subject is bad. 
[0012] By measuring a person's flesh color, JP,8-154259,A presumes a person's existence region, extracts 
the person image, and lacks in versatility. 

[0013] Thus, it was difficult to perform semi-automatically image processing of adding a predetermined 
shading off or deformation to the main photographic subject or the background of having an arbitration 
configuration in an image, or the color scheme of arbitration, in the conventional example by automatic or 
simple actuation. 

[0014] This invention aims at showing the image processing system and method list which cancel such 
un arranging a storage. 

[0015] This invention aims at showing the image processing system and method fist which make it 
possible to perform automatically or semi-automatically image processing of adding a predetermined 
shading off or deformation to the main photographic subject or the background of having an arbitration 



configuration in an image, or the color scheme of arbitration again a storage. 
[0016] 

[Means for Solving the Problem] An image processing system concerning this invention Image formation 
optical system, a photo-electric-conversion means, a video signal processing means, A directions selection 
means for making directions selection of the particular part of an image input means including a storage 
means and a control signal generating means, and an inputted image, It has an image display means in 
an image -processing means, an image coding means, an image recording means, and an image recording 
data-medium list. A specific photographic subject extract means to extract a specific photographic subject 
in an image using image information of a portion by which directions selection was made with a 
directions selection means in an image into which an image-processing means was inputted, It is 
characterized by having a background image memorized by a storage means or image recording data 
medium and a synthetic image generation means to compound this extracted specific photographic 
subject. 

[0017] This inputs a photographic subject image including a background of arbitration (photography), and 
actuation with simple generating a synthetic image of a background image and a photographic subject 
which are different from a background in a photographic subject image after extracting a photographic 
subject in it can realize. Moreover, by displaying a compounded image on an image display means, a 
location and magnitude of a photographic subject in a synthetic image can be checked, and after a 
directions selection means adjusted them further and taking a background and suitable matching, a 
synthetic image can be recorded, saved or outputted. 

[0018] An image processing system concerning this invention Image formation optical system, a 
photo electric-conversion means, a video signal processing means, A directions selection means for 
making directions selection of the particular part of an image input means including a storage means and 
a control signal generating means, and an inputted image, It has an image display means in an 
image-processing means, an image coding means, an image recording means, a communications control 
means, and an image recording data-medium list. A specific photographic subject extract means to extract 
a specific photographic subject in an image using image information of a portion by which directions 
selection was made with a directions selection means in an image into which an image -processing means 
was inputted, It is characterized by having an input means of a background image through a 
communications control means, and a background image and a synthetic image generation means to 
compound an extracted specific photographic subject. 

[0019] Thereby, in addition to the above-mentioned feature, a background image is inputted from the 
outside, and actuation with simple composition with a photographic subject in a **** image and a 
photographic subject image including a background of arbitration can realize. 

[0020] In this invention, a control signal generating means inputs an auxiliary data about a configuration 
and a location of a specific photographic subject from a storage means, and it is characterized by 
displaying an auxiliary data on an image display means. By this, when a configuration or a style, a 
location, etc. of a photographic subject have become settled in general beforehand, by inputting the data 
(for example, border line of a rectangle frame or a photographic subject model same type etc.), and 
displaying on an input image in piles When a posture of a photographic subject in a photographic subject 
image etc. can be adjusted so that the auxiliary data may be suited in a site of image inputs, such as 
photography, activation of a body ed extract is attained without performing partial assignment of an 



image for a photographic subject extract by directions selection means. 

[0021] In this invention, a control signal generating means inputs an auxiliary data about a configuration 
and a location of a specific photographic subject from a communications control means, and it is 
characterized by displaying an auxiliary data on an image display means. Thereby, in addition to said 
feature, an auxiliary data can be inputted from the outside of an image pick up image-processing means. 
[0022] An image processing system concerning this invention Image formation optical system, a 
photo electric-conversion means, a video signal processing means, An image input means, an 
image -processing means including a storage means and a control signal generating means, It has an 
image display means in an image coding means to have an image format conversion means, an image 
recording means, and an image recording data-medium list. An image format conversion means within an 
image coding means An image memorized by a storage means or image recording data medium is 
changed into a predetermined format. An image coding means changes a format of predetermined image 
data recorded on a storage means or image recording data medium. An image-processing means It is 
characterized by performing specific photographic subject extract processing in an inputted image, and 
carrying out image composition of an extracted specific photographic subject image and the image by 
which format conversion was carried out with an image format conversion means. 

[0023] In an image-processing means equipped with a photographic subject extract which has by this the 
feature mentioned above, and an image composition processing facility, since a transform -processing 
means to a format suitable for image composition processing for the interior was built in, the selection 
range of a format of image data inputted can be extended sharply. 

[0024] An image processing system concerning this invention Image formation optical system, a 
photo-electric-conversion means, a video signal processing means, An image input means, an 
image-processing means including a storage means and a control signal generating means, It has an 
image display means in an image coding means, an image recording means, and an image recording 
data-medium list. A control signal generating means has a photography condition measurement control 
means, and an image coding means encodes image data. Photography conditions are recorded on a record 
medium or a storage means in a predetermined format with encoded image data. It is characterized by an 
image-processing means compounding an image (background) which performed specific photographic 
subject extract processing in an inputted image, and was recorded on an extracted specific photographic 
subject, a storage means, or image recording data medium based on photography conditions, 
[0025] Thereby, after performing gray scale conversion etc. based on photography conditions, a natural 
synthetic image which lost an extracted difference among photography conditions of an image and a 
background image of a photographic subject is obtained automatically. 

[0026] In this invention, an auxiliary data is characterized by being a border line or mask data of 
predetermined size about a specific photographic subject. When a photographic subject configuration has 
become settled in general by this, a photographic subject extract can be automatically performed by 
obtaining a posture or a style of a photographic subject etc. which suited an auxiliary data in a site of an 
image input (photography), and extracting a field inside an auxiliary border line by displaying the border 
line or its contrant region on an input image in piles (special display of coloring etc.). Furthermore, when 
a background of a background image and a photographic subject image is mostly in agreement, precision 
of a photographic subject extract improves sharply. 

[0027] In this invention, an auxiliary data is characterized by being the close border line of a 



predetermined configuration. Even if it does not approximate a configuration of a photographic subject, as 
mentioned above, when a background of a background image and a photographic subject image is mostly 
in agreement, precision of a photographic subject extract improves sharply by specifying a photographic 
subject field with a very rough configuration given by close border hnes, such as a rectangle reflecting the 
size in every direction, or an ellipse. 

[0028] In this invention, photography conditions are characterized by including a class and the direction 
of a look of light exposure or shutter speed, the amount of focuses, a photography scale factor, and 
illumination light. It is because a difference among these photography conditions is absorbed between a 
photographic subject image and a background image and a natural synthetic image is obtained. In 
addition, the direction of a look is used for assignment of a field that a photographic subject only exists etc. 
[0029] In this invention, an image -processing means performs synthetic processing of an image, after one 
image performs predetermined transform processing to some [ at least ] fields of an image based on a 
difference between photography conditions at the time of photography of an inputted image, and 
photography conditions of a background image so that while may carry out abbreviation coincidence with 
photography conditions of an image of another side. A natural image can be obtained, when one gradation, 
color tone, contrast, or sharpness of an image etc. is changed based on photography conditions and it 
compounds with an image of another side by this. 

[0030] In this invention, a control signal generating means inputs an auxiliary data about a configuration 
and a location of a specific photographic subject from a storage means, and is characterized by changing a 
configuration or a location of an auxiliary data based on photography conditions. Since the features (a 
configuration of a border line, contrast, etc.) of an auxiliary data can be automatically changed proper 
according to photography conditions of an input image even when [ from which photography conditions (a 
scale factor, lighting conditions exposure conditions etc.) when inputting a background image 
(photography) and photography conditions at the time of an input of a photographic subject image differ 
by this ] case or changing, it can simplify and subsequent photographic subject extract processing can be 
performed. 

[0031] A step into which an image -processing method concerning this invention inputs an image from a 
predetermined image input means, Measurement or a setting step of an image input condition of an 
inputted image, a step which records an image input condition on a predetermined storage means, A 
photographic subject extract step which extracts a specific photographic subject from an inputted image, 
an image composition step which compounds an image of a photographic subject extracted based on an 
image input condition, and a background image recorded on a predetermined storage means, It is 
characterized by consisting of an image output-control means step which performs an output to record or 
a predetermined display means by predetermined format for a predetermined storage means of a 
synthetic image obtained at an image composition step. 

[0032] Thereby, it is not concerned with a difference or fluctuation of an image input condition, but image 
composition with a specific photographic subject in a predetermined input image and a background image 
is made to a natural thing. Moreover, as long as the procedure is followed, image composition stabilized 
without being based on configuration is attained. 

[0033] This invention is characterized by to provide an image transformation means or a step which 
performs predetermined conversion to an image of a background region except an object domain or an 
object domain an image input means or a step, an image pick up condition extract means or a step, an 



image transformation mode setting means or a step, a field extract means or a step that asks for a 
predetermined object domain using image pick-up conditions from an input image, and among input 
images. Thereby, a partial configuration of a photographic subject can certainly be specified from image 
pick up conditions etc., and image pick up equipment or a picture input device which can add and 
picturize desired conversion can be realized. 

[0034] This invention An image input means, an image display means, and an image pick up condition 
extract means, An image transformation mode setting means and a field setting means to set up a 
predetermined object domain based on the image transformation mode concerned or the image pick-up 
conditions concerned from an input image, It is characterized by providing a boundary layer display 
means to superimpose a boundary line of a setting field on an input image, and to display on an image 
display means, and an image transformation means to perform predetermined conversion to an image of 
a background region excluding an object domain or an object domain among input images. This invention 
is characterized by to provide an image input step, an image pick up condition extract step, an 
image -transformation mode- setting step, the field setting step that sets up a predetermined object 
domain based on the image-transformation mode concerned or the image pick-up conditions concerned 
from an input image, the boundary layer display step which superimposes a boundary line of a setting 
field on an input image, and display on an image-display means, and the image-transformation step 
which perform predetermined conversion to the image of the background region excluding an object 
domain or an object domain among input images. Photography from which a photographic subject is 
changed in a field which corresponds after checking by looking a field where a conversion field according 
to a photographic subject could be set up automatically and a user was set up by this, or an image input 
which can check an image after conversion is realized. 

[0035] Moreover, this invention is characterized by to provide the image-transformation means or the 
step which performs predetermined conversion to the image of the background region excluding an object 
domain or an object domain among a field extract means or a step which asks for a predetermined object 
domain, and input images based on an image input means or a step, an image pick up condition extract 
means or a step, an image-transformation mode-setting means or a step, and the image pick-up 
conditions concerned or the image-transformation mode concerned. [ image / input ] An image input can 
be carried out, after being able to extract a field of a photographic subject from an image automatically 
based on image pick-up conditions etc. and changing a request to the extract field by this. 
[0036] In this invention, an image transformation means or a step is characterized by performing 
predetermined texture-mapping processing to an object domain based on image pick up conditions or 
image transformation mode. Moreover, an image transformation means inputs other images from a 
predetermined storage means, and is characterized by changing an object domain by other images based 
on image pick up conditions or image transformation mode. By these, an image input means by which a 
specific region according to image pick up conditions or image transformation mode is convertible is 
offered. 

[0037] Moreover, an image transformation means or a step is characterized by changing a specific color 
component of an object domain into other color components. An image input means by which a color 
component of an object domain pinpointed using image pick up conditions etc. is automatically 
convertible by this is realizable. 

[0038] In this invention, an image transformation means or a step is characterized by performing 



predetermined geometric deformation to an object domain. An image input, means by which geometric 
deformation of affine transformation etc. can be added to an object domain pinpointed using image 
pick up conditions etc. by this is realizable. 

[0039] In this invention, it is characterized by an image transformation means or a step adding 
predetermined watermark information to image data after conversion. Thereby, information, such as a 
field for a transducer and a translation mode, is recordable in not being visually perceived with an image. 
Furthermore, after treatment of restoring an image before conversion based on such information can 
perform simply. 

[0040] difference of a background image and an input image into which a field extract means or a step 
was beforehand inputted in this invention - it is characterized by asking for an object domain based on 
data. Thereby, a field for conversion can be pinpointed automatically. 

[0041] In this invention, a field extract means is characterized by providing a field extract means to 
extract a field where similarity serves as a storage means of a predetermined template model image, and 
a similarity detection means of a template model and an input image with below a predetermined 
threshold or the maximum. A field extract step is characterized by providing a similarity detection step 
which detects similarity of a template model and an input image which are memorized by storage means, 
and a field extract step which extracts a field where similarity serves as below a predetermined threshold 
or the maximum. Thereby, while changing template size appropriately using image pick-up conditions 
etc., a picture input device which can pinpoint a field for conversion automatically as a high field of a 
template configuration and similarity is realizable. 

[0042] In this invention, an image transformation means or a step is characterized by performing 
conversion of an intensity level or a color component value based on image pick-up conditions about a part 
of object domain or background region. A picture input device which can specify and carry out image 
transformation of the portion which should be changed beforehand by this in a field pinpointed as a 
candidate for conversion is realizable. 

[0043] In this invention, a field extract means or a step is characterized by what a boundary line of an 
extract field is superimposed on an input image, and is displayed on said image display means. Thereby, a 
user can perform image transformation photography, after checking the range of an extracted field. 
[0044] In this invention, a field setting means or a step is characterized by having a location or a 
size-change means of a field. Conversion photography which can adjust set;up a location or size of a 
conversion field simply by this can be performed. 

[0045] In this invention, a field extract means or a step sets up a location and size in an input image of a 
template model image based on image pick up conditions, and it is characterized by asking for a border 
line of an object domain by making a border line of a set up template model image into an initial outline. 
Even if it is the photographic subject which has a border line which is somewhat different from a 
configuration specified with a template model by this, conversion photography which can perform image 
transformation automatically about a field inside a right border line is attained. 

[0046] In this invention, it is characterized by displaying the border line, when a display action of a 
border line is chosen by border-fine display means or display selection means predetermined in a step. 
Thereby, conversion (or the reverse) in conversion photography mode from photography mode, a check for 
conversion, etc. can usually be performed. 
[0047] 



[Example] Hereafter, the example of this invention is explained to details with reference to a drawing. 
[0048] Drawing 1 shows outline configuration block drawing of the 1st example of this invention. The 
image formation optical system 12 in which the image pick up image processing system 10 includes a 
taking lens and the drive controlling mechanism for zoom photography, an image sensor 14 like CCD 
series, the measurement control circuit 16 which measures and controls an image pick-up parameter, the 
video signal processing circuit 18, storage 20, control of image pick up actuation, Control of image pick up 
conditions, The control signal of an image processing and an image output The control signal generating 
circuit 22, EVF to generate (Electronic view finder) etc. - in the directions selecting arrangement 26 
which consists of the display display 24, a pen mold key, or a cross-joint key etc. which makes a finder 
serve a double purpose, stroboscope luminescence equipment 28, a record medium 30, the image coding 
network 32, the image output circuit 34, the photographic subject extract circuit 36, and a list The image 
composition circuit 38 is provided. 

[0049] An image pick-up parameter measurement control circuit 18 possesses the control signal 
generating circuit which generates the control signal of video signal properties, such as a gamma property, 
a knee property, and color balance, in the light-exposure control circuit which controls the scale -factor 
detector which detects the scale factor of the zoom lens which can change a photography scale factor freely, 
the focus condition detector which detects the focus condition on the image pick-up side of an image 
sensor 14, the charge storage time of an image sensor 14, and/or the diameter of a opening of drawing of 
the image -formation optical system 12, a stroboscope luminescence control circuit, and a list. These parts 
are realized by software. An image pick-up parameter includes the direction of a look, the existence of 
stroboscope luminescence, the classes (for example, daylight, a fluorescent lamp, an incandescent lamp, 
stroboscope light, etc.) of illumination light, etc. other than whenever [ photography scale-factor and 
focus ], and light exposure. The direction of a look is detected by the look detection equipment (not shown) 
built in the video signal processing circuit 18. 

[0050] The video signal processing circuit 18 has amendment circuits, such as gamma, a knee, and a 
white balance, an automatic focus (AF) circuit, an automatic-exposure-control (AE) circuit, an 
automatic gain-control (AGO circuit, etc. 

[0051] The directions selecting arrangement 26 consists of a pen mold key, a cross-joint key, etc. However, 
the touch panel is united with the display display 24, and when the panel for actuation is displayed on the 
screen of the display display 24, the displayed panel for actuation becomes one gestalt of the directions 
selecting arrangement 26. 

[0052] A record medium 30 consists of various data medium, such as disk media, such as a magnetic tape, 
an optical disk, or a magneto-optic disk, a flash memory, and an IC memory. In this example, a record 
medium 30 is not limited to special data medium. A record medium 30 can be freely detached and 
attached to the image pick up image processing system 10. 

[0053] The image coding network 32 carries out compression coding of the image data in a predetermined 
format with incidental data, such as photography conditions. 

[0054] With reference to drawing 2 , the extract of the photographic subject which is characteristic 
actuation of this example, and a synthetic process with a background image are explained. 
[0055] A user photos an image including the photographic subject which should be extracted (Si), and 
extracts the field image in which a photographic subject exists by the photographic subject extract circuit 
36 using the directions selecting arrangement 26 etc. (S2, S3). For example, several [ on the border line of 



the photographic subject of the input image displayed on the display display 24 ] are directed with the 
directions selecting arrangement 26, and the reference point of a photographic subject extract is set as the 
photographic subject extract circuit 36. The photographic subject extract circuit 36 performs an edge 
trace to which between adjacent data is connected by the predetermined method, and obtains the border 
line of the photographic subject as one closed curve. Edge data can be obtained space differential filtering 
processing of SOBEL, Laplacian, etc. by the well-known method to an input image. Thus, the image of the 
field inside the closed curve obtained is extracted as a photographic subject image (S3). The extract 
method of the closed curve equivalent to the outline of a photographic subject is not limited to the method 
mentioned above. 

[0056] Compression coding is carried out by the predetermined compression method (for example, 
compression coding method using a wavelet transformation, DCT conversion, etc.), and the image data of 
the extracted photographic subject field is stored in storage 20 in a predetermined format with 
photography conditions, such as a photography scale factor and exposure conditions (charge storage time 
of an image sensor, existence of stroboscope luminescence, etc.), (S4). 

[0057] Next, a background image is photoed or inputted (S5). The photographic subject image extracted 
previously is read from storage 20 or a record medium 30, displaying a background image (S6). The 
gradation and the color tone of a photographic subject image are adjusted (S7), and mixing with a 
background image and smoothing of a photographic subject near an outline are performed, and it 
compounds so that a photographic subject image may be overwritten at a background image, and displays 
on the screen of the display display 24 so that differences, such as gradation by the difference among the 
photography conditions between a background image and a photographic subject image and a color tone, 
may be controlled (S8). In order to gather the display speed of the display display 24, it may be made to 
perform amendment processing depending on photography conditions at the time of record of a synthetic 
image. 

[0058] Drawing 3 shows the example of the display screen of the display display 24. The photographic 
subject image display fields 40a, 40b, and 40c which display three photographic subject images obtained 
as a result of extract processing on the display display 24, The synthetic image display field 42, the 
expansion carbon button 44 which directs an enlarged display, the contraction carbon button 46 which 
directs a reduced display, the navigation key 48 which directs migration on four directions, return key 
which directs return to pretreatment 50a, and delivery key 50b which directs the next processing or 
subsequent ones are displayed. 

[0059] According to directions of a user, the location and size of a photographic subject image are adjusted 
(S9). At this time, the auxiliary frame 52 which expresses the size and the location of a photographic 
subject roughly is displayed to surround the photographic subject image on a synthetic image. 
Highlighting of the selected photographic subject image (image displayed on photographic subject image 
display field 40a in drawing 3 ) is carried out by **** etc. so that it may turn out to be it. Such an 
expression method is common knowledge. Drawing 4 shows the synthetic example which detached and 
added a little still more nearly same photographic subject image. Since a photographic subject image 
becomes large as a result, the auxiliary frame 52 in which the location and size of a photographic subject 
image are shown is larger than the case of drawing 3 . 

[0060] A user operates the expansion carbon button 44, the contraction carbon button 46, and the 
navigation key 48 for repositioning with a touch pen, a mouse, or a finger, and can change the size and the 



location of a photographic subject image. The graphical user interface using such carbon buttons itself is 
common knowledge. Although it is needless to say, such a manual operation button etc. may be set as the 
predetermined location on the surface of the main frame. It can return to a front processing phase by 
return carbon button 50a, and can shift to the next processing phase by stepper-button 50b. 
[0061] A user judges that it is in the suitable arrangement and the size in a background image the size of 
the extracted photographic subject image, and as a result of adjustment of a location, if a user pushes the 
synthetic record carbon button on a control panel, compression coding will be carried out and synthetic 
image data (of course, the auxiliary frame 52 is removed.) will be recorded on storage 20 or a record 
medium 30 (SlO). In the case of this record, the photography conditions used for the synthetic image 
generate time may be encoded as incidental information, and you may record on the header unit of an 
image data file etc. As incidental information, parameters, such as the center-of-gravity location of the 
rectangle frame (for example, auxiliary frame 52 of drawing 3 ) circumscribed to the coordinate of each 
point on the border line of the photographic subject portion at the time of synthetic record and its border 
line other than photography conditions and size in every direction or a center-of-gravity location of the 
ellipse circumscribed to the border line, size of the main shaft, a direction, and an ovality, may be included. 
[0062] Apart from a synthetic image, the incidental information about such a configuration of a 
photographic subject, a location, and size can be read by next photography, and can also be displayed on 
the display display 24 in piles as an auxiliary data at an image. By doing in this way, the time and effort 
which a photographic subject extract takes in a series of processings from the extract of a photographic 
subject to perform to composition with a background about a photographic subject of the same kind can be 
saved. 

[0063] After drawing 5 indicates the border line of an extract photographic subject image by superposition 
previously at a background image and adjusts the location and size of a photographic subject image, it 
shows the modification flow chart which compounded the photographic subject image. S11S15 are the 
same as SI S5 of drawing 2 . The border line of an extract photographic subject image is indicated by 
superposition at a background image (Sl6), and the location and size of a photographic subject image are 
adjusted (S17). Then, extract photographic subject image data and incidental information data are 
inputted, a photographic subject image is compounded to a background image, as it enters into a border 
line (S18), a photographic subject image is amended according to photography conditions etc. (S19), and a 
synthetic image is recorded on a record medium 30 (S20). 

[0064] In addition, when the background in a background image and the photographic subject image 
before extract processing is performed is almost the same, even if the image field which should be 
extracted contains a part for a background to some extent, if it removes a changed part produced 
according to factors, such as a difference among photography conditions, it hardly poses a problem at the 
time of composition. Therefore, it cannot be overemphasized that in such a case a photographic subject 
may be roughly extracted and used including a background with a rectangle frame, an ellipse, etc. as 
mentioned above. 

[0065] Therefore, automatic extracting of the field which corresponds in the rectangle frame 54 of an 
applicable part when the image which removes an unnecessary person or an unnecessary body by 
photographic subject extract processing, and is obtained at the time of photography, i.e., the image with 
which a certain field was missing as shown in drawing 6 , is used as the 1st image, next a **** image is 
photoed may be carried out, and the 1st image may be compounded so that the image field for a 



background after removal may be filled up. Photographic subject image 40c of drawing 6 extracts the 
image in the rectangle frame 54, and is obtained. Also in this case, a synthetic result is displayed on a 
display means, and with directions of a user, a synthetic result image is encoded and it records on a 
predetermined record medium. 

[0066] Next, the 2nd example of this invention is explained. In the 2nd example, the image (the 1st image- 
don't ask an animation or a still picture.) prepared beforehand is captured through a record medium or 
means of communications of a main part etc. which can be detached and attached, and it compounds with 
the image (the 2nd image: don't ask an animation and a still picture.) photoed on the spot, and the 
synthetic image obtained as a result is recorded on the record medium or storage of a main part, or is 
outputted outside. Drawing 7 shows outline configuration block drawing of the example. The same sign is 
given to the same component as drawing 1 . As for the record medium which 140 can detach and attach 
freely, and 142, a communications control circuit and 144 are image data format conversion circuits. In 
case the image data format conversion circuit 144 changes into a predetermined content-type the image 
data of various formats inputted through communications control circuit 142 grade and outputs image 
data outside through the communications control circuit 142, it is changed into external predetermined 
format from a con tent- type. 

[0067] In this example, when the 1st image is a photographic subject image with which logging was 
already performed, the 1st image is compounded with the 2nd image (background image), without 
performing photographic subject extract processing mentioned above after the input of the 1st image. In 
addition, photographic subject extract processing may be performed to the 2nd image, and you may 
compound with the 1st image. 

[0068] As the gestalt of the image inputted from the outside through the communications control circuit 
142, and a class of image For example, a document image, a photograph, etc. of file format which were 
transmitted from the external terminal which goes via TV or a video image, the telephone line, etc., It is 
various, and although this example is not limited to either, data format presupposes that it is the image 
data transmitted to the list with other wireless or cables from image input devices (a digital camera, a 
scanner, FAX, etc.) a well-known thing. Similarly, what is necessary is just the thing of the format 
common knowledge of the classification of the image data recorded on a record medium 140. 
[0069] In this example, the data format which can be inputted is defined beforehand and a user chooses 
from them, the video signal with which coded-image data was treated as input data format, the 
classification was specifically judged at the time of an input (an automatic judging or manual judging by 
the user), and it was encoded [ DPCM ] - or the file format by which predetermined was encoded is 
identified. The image data by which run length coding was carried out [ MR / (MODIFAIDO lead) / DPCM 
coding or ] as a video signal, The thing of animation correspondences as a file format, such as MPEG and 
QuickTime (trademark of U.S. Apple Computer, Inc.), Bit map format, such as JPEG, TIFF, BMP/DIB, 
and GIF, PICT, PCX, It can incorporate with the data stream of the printer represented by 
three -dimension scene symbolic conventions for rendering applications, such as RIB, and PCL, and 
spreadsheet image formats, such as XLS, can be inputted into drawing data format, such as bit image 
format and other PPT, and a list. 

[0070] The inputted image data is decrypted, and after an error correction is carried out, a format is 
changed into it by the fixed format (bit map format, such as TIFF, BMP/DIB, or JPEG, is typical.) which 
suits an internal image processing if needed. 



[0071] The 1st image is a dynamic image, and when extracting a photographic subject from one of them 
and compounding with the 2nd image (background image), one frame which the user chose is changed 
into the data format of a static image. 

[0072] The 1st image is a dynamic image by which the photographic subject extract was already carried 
out, and in the case of animation format, the 2nd image also prepares the keying signal generating said 
way and the synthetic circuit as a part of image processing means inside a main part, generates a keying 
signal about the photographic subject field in the 1st image in it, and may compound a photographic 
subject image (foreground image) and a background image to it with an animation. 

[0073] With reference to drawing 8 , the actuation and procedure of an example which are shown in 
drawing 7 are explained. First, a user chooses three kinds of one, a photography input, a communication 
link input, and a data-medium input, as image input mode of the 1st image (S2l), stores in storage 20 the 
image inputted in the appointed image input mode (S22), and displays on the display disk play 24 (S23). 
While specifying a communication configuration or the source in a communication link input, inputting 
image data between 1 scheduled time or the number of fixed sheets by a predetermined protocol or a 
predetermined correspondence procedure and memorizing to storage 20, it displays on the display display 
24. In a data-medium input, a list of the record image of a record medium 140 is displayed, the image of 1 
or two or more requests is chosen as it from the inside, and it reads into storage 20. A display and 
selection of the image after taking a photograph also in a photography input are the same. 
[0074] A user chooses one suitable image frame or a series of dynamic-image frames from the image 
displayed on a display 24 (S24), and stores in storage 20 as the 1st image (S25). 

[0075] The photographic subject image which a user should use the directions selecting arrangement 26 
when photographic subject extract processing is not yet made to the 1st image, and he should extract 
from the 1st image is specified, and the photographic subject extractor 36 extracts a photographic subject 
image by the same processing as a previous example (S26). The location and size of a photographic subject 
image to a background image are adjusted (S27). At this time, it specifies whether a background image is 
overwritten and a photographic subject image is displayed or in order not to lower the display speed to 
the display display 24, only the border line of a photographic subject image is displayed on a background 
image in piles. A means for that is the same as that of the example explained previously, and is good. 
[0076] When the photography condition is attached to the photographic subject image and/or the 
background image as incidental information, like the 1st example, based on the difference among 
photography conditions, one gradation, color tone, etc. of an image are changed so that it may agree with 
the image of another side mostly (S28), a synthetic image is generated (S29), and it records on a record 
medium 140 (S30). 

[0077] In addition, when the class and exposure conditions of the illumination light are not attached to 
image data as photography conditions, it enables it for a manual to adjust gradation and/or a color tone 
(S31-33). Even if photography conditions are attached to image data, this can be used also when it cannot 
be satisfied with automatic amendment of gradation and a color tone. If the slide bar 150 for lightness 
conversion (or carbon button) and the slide bar 152 for saturation conversion (or carbon button) are 
displayed on a display panel and a user specifically operates which slide bar (or carbon button) 150, 152 so 
that it may be set as manual adjustment mode (S3l) and may illustrate to drawing 9 , the color tone and 
contrast (or lightness and saturation) of a photographic subject image portion will be adjusted (S32). Of 
course, after specifying the particular part of a photographic subject, the color tone etc. can also be 



adjusted. If a user checks a synthetic result and inputs record directions (S33), a synthetic image will be 
recorded on a record medium 130 (S30). 

[0078] Thus, simple actuation can generate a natural synthetic image and it can record in the site of 
photography. 

[0079] In each above-mentioned example, you may record on storage 20 or a record medium 30,140 at the 
photographic subject border line obtained as an extract processing result of a photographic subject, or its 
border line by using as auxiliary border-line data the rectangle frame data which carries out abbreviation 
circumscription. As shown in drawing 10 , when the auxiliary outline display carbon button 154 is formed 
in a display panel and the carbon button 154 is pushed, the control signal generating circuit 22 reads the 
auxiliary border-line data from storage 20 or a record medium 30,140, and makes an input image display 
in piles as an auxiliary border line 156 on the screen of the display display 24. The photographic subject 
image 158 surrounded by the auxiliary border line 156 does not need to be in agreement with 
photographic subject image 40c. 

[0080] If the set-up photography conditions (especially a photography scale factor, the direction of a look, 
etc.) are changed, this will be interlocked with and the size location and configuration of the auxiliary 
border line 156 will be changed automatically. In this case, if the size A of a proper is beforehand given to 
the photographic subject as incidental information, the size on the screen decided by photography 
conditions, such as a photography scale factor and photographic subject distance (it presumes from 
whenever [ focus ] etc.) of an outline, will be calculated, and the auxiliary border line 156 will be displayed 
on the display display 24 in the magnitude which suits that size. 

[0081] For example, in a focal distance, if distance from the 2nd principal point location of A and image 
formation optical system to an image sensor side is set [ the gap from the maximum of f and focus level ] 
to v for dp and the standard size of a photographic subject, the photographic subject size S on a screen will 
be given by the bottom formula, namely, - S=A(v-£) (l+(v£) dp/f)/f (l) 

However, fluctuation of photographic subject distance and fluctuation of focus signal level consider as 
linearity. Therefore, what is necessary is just to change the size of an auxiliary data according to 
scale-factor S/A based on a formula (l), if dp is measured and it asks for f from a lens location. 
[0082] Moreover, a user resets an auxiliary data as a suitable location using the directions selection 
means 26 if needed, and may correct the size etc. 

[0083] The photographic subject extract technology used in the above-mentioned example is explained. 
Generally it indicates by setting in the suitable location on an input image by making an auxiliary border 
line (or mask data as field data inside an auxiliary border line) into an initial outline (or initial field), and 
the following photographic subject logging processings are performed by making it into an initial data. 
[0084] Specifically, the method of using a dynamic outline as the base is used (331 D.Terzopoul M.Kass, 
A.Witkin, os, "Snakes^Active Contour Models", International Journal of Computer Vision, pp.321- 1988). 
A dynamic outline method is a method of extracting an objective outline from edge information, and an 
initial border line is completed as the outline on a body by transforming a border-line model so that the 
energy performance index which meant as a constraint that an outline is smooth, that it was on an edge, 
etc. may serve as min. Moreover, it is based on a difference with the characteristic quantity of the image 
of the near field of for example, an initial outline, and the image about the local field of a photographic 
subject portion as concrete technique into which this was developed. The technique of making the inner 
sense or outward external force act on the point on the outline of a dynamic outline is known. (For 



example) R. Ronfard and "Region-Based Strategies for Active Contour Models" and International 
Journalof Computer Vision and pp.229- 251 and 1994 - and dynamic "outline extract based on 
description of field obtained from clustering" Institute of Electronics, Information and Communication 
Engineers paper magazine D-II besides Eito, vol.J75-D-II, and pp.1111- 1119, 1992, etc. 
[0085] Although especially the technique of image logging is not limited, an initial outline configuration is 
the method that logging can be performed, automatically in the conditions which approximate a 
photographic subject configuration well, and the above-mentioned method has it at this point. 
[ desirable ] 

[0086] Rough assignment (for example, a closed curve or a rectangle frame surrounding an object etc.) 
about the location and magnitude for logging may be performed, and you may record beforehand with an 
image as incidental data. After treatment performs image logging or image composition on other 
terminals after photography termination. Moreover, the image data inside a border line is extracted as it 
is, and it may compound with a background image and you may record. 

[0087] Drawing 11 shows outline configuration block drawing of the 3rd example of this invention. The 
image formation optical system 212 in which the image pick-up image processing system 210 includes a 
taking lens and the drive controlling mechanism for zoom photography, an image sensor 214 like CCD 
series, the measurement control circuit 216 which measures and controls an image pick-up parameter, 
the video signal processing circuit 218, storage 220, control of image pick up actuation, Control of image 
pick up conditions, The control signal of an image processing and an image output The control circuit 222, 
EVF to generate (Electronic view finder) etc. - a finder The display display 224 made to serve a double 
•purpose, a pen mold key Or photography mode setting equipment 240 is provided in the directions 
selecting arrangement 226 which consists of a cross-joint key etc., stroboscope luminescence equipment 
228, a record medium 230, the image coding network 232, the image output circuit 234, the photographic 
subject extract circuit 236, the image transformation circuit 238, and a list. 

[0088] Equipment 210 is divided into main part 210a and image-processing section 210b, the 
photographic subject extract circuit 236, the image transformation circuit 238, and display display 224b 
are held in image-processing section 210b, and you may make it hold the remainder in main part 210a, as 
shown in drawing 12 . 

[0089] The touch panel is united with the display display 224, and when the panel for actuation is 
displayed on the screen of the display display 224, the displayed panel for actuation becomes one gestalt 
of the directions selecting arrangement 226. 

[0090] A video signal processing circuit 218 possesses the control signal generating circuit which 
generates the control signal of video signal properties, such as a gamma property, a knee property, and 
color balance, in the light-exposure control circuit which controls the scale-factor detector which detects 
the scale factor of the zoom lens which can change a photography scale factor freely, the focus condition 
detector which detects the focus condition on the image pick-up side of an image sensor 214, the charge 
storage time of an image sensor 214, and/or the diameter of a opening of drawing of the image-formation 
optical system 212, a stroboscope luminescence control circuit, and a list. These parts are realized by 
software. An image pick up parameter includes the direction of a look, the existence of stroboscope 
luminescence, the classes (for example, daylight, a fluorescent lamp, an incandescent lamp, stroboscope 
light, etc.) of illumination light, etc. other than whenever [ photography scale-factor and focus ], and light 
exposure. The direction of a look is detected by the look detection equipment (not shown) built in the 



image pick-up image processing system 210. 

[0091] The video signal processing circuit 218 has amendment circuits, such as gamma, a knee, and a 
white balance, an automatic focus (AF) circuit, an automatic-exposure -control (AE) circuit, an 
automatic-gain-control (AGO circuit, etc. 

[0092] Storage 220 becomes ROM and the list which store the processing program used for a frame buffer, 
a Video RAM, the template data used for conversion photography, and image transformation from other 
primary storage means. 

[0093] A record medium 230 consists of various data medium, such as disk media, such as a magnetic tape, 
an optical disk, or a magneto-optic disk, a flash memory, and an IC memory. In this example, a record 
medium 230 is not limited to special data medium. A record medium 230 can be freely detached and 
attached to the image pick-up image processing system 210. 

[0094] The image coding network 232 carries out compression coding of the image data in a 
predetermined format with incidental data, such as photography conditions. 

[0095] In this example, a request can be automatically processed in a photography image at the time of 
photography. This is called conversion photography mode on these specifications, conversion photography 
mode - bloodshot-eyes amendment mode, mustached removal mode, and silverfish - there is 
removal/addition mode of a freckle etc. About size, a location, etc. in the screen of a photographic subject, 
if it is selectable and there is no assignment from a user especially at this example about the 2 of 
automatic detection mode and manual setting mode modes to one, as for a user, automatic detection mode 
shall be set up. 

[0096] In this example, it shall record and prepare for storage 220 or image recording data medium 230 
beforehand at the model border line belonging to a photographic subject category, or its border line by 
using as auxiliary border-line data the border line coordinate data of the frame of the predetermined 
configurations (a rectangle or ellipse) which carry out abbreviation circumscription. Moreover, what 
consists of a partial border line showing the category for an extract of a configuration as a model border 
line, for example, the model which consists of a partial feature element indicated by JP, 7- 320086, A by the 
same applicant as this application, may be used. 

[0097] The auxiliary border-line (above-mentioned model border line) data which has the size set up by 
the method of mention later based on photography conditions, such as a scale factor and photographic 
subject distance, is scanned sequentially from the edge on a screen, whenever [ with the edge intensity 
distribution of an input image / coincidence ] (for example, correlation value) is evaluated in automatic 
detection mode in each location, and it asks for the maximum location of whenever [ coincidence ] as an 
optimal location. Thus, even if it is a case as two or more extract object domains are included, automatic 
activation of two or more detection and field extracts of the location of a photographic subject field can be 
carried out. 

[0098] The contents of each translation mode are explained briefly, mustached removal (addition) mode 
and silverfish - in freckle removal mode, a person's head or face is first detected from an input image. 
[0099] It is good by the method of detecting the location where a standard template image (a shade image 
or color picture) is used for others, it is changed into suitable size as detection processing of a face or an 
eye based on photography conditions, a correlation value is calculated [ location ] in each location in an 
image, and correlation serves as max or the maximum. 

[0100] in manual setting mode, a control circuit 222 is shown below - as - auxiliary border lines (border 



line of the face displayed with a closed curve etc.) - the screen top of a display 224 - displaying - the 
inside of the auxiliary border line - outline ****** like, a user adjusts image pick-up conditions, such as 
a scale factor and a line of sight, or the location and size of an auxiliary border line are changed. 
[0101] In the bloodshot-eyes amendment in automatic detection mode, the eye in an input image is 
detected and the pixel equivalent to bloodshot eyes is alternatively changed into black etc. The details of 
this processing are mentioned later. I display on the screen of a display 224 by making the model border 
line (both eyes or one eye) of an eye into an auxiliary border line, and have a user set up image pick-up 
conditions in manual setting mode. 

[0102] In mustached removal mode, the beige component of a face is extracted after detection of a face 
field, and the field pixel of black or off-white is changed beige except for the hair in a face in the field to 
which a mustache may exist. 

[0103] silverfish - in freckle removal mode, the representation color component value of the beige 
component of a face is extracted after detection of a face field, and the pixel value of the field which has an 
especially different color component from a beige representation color component value in each field of a 
cheek, a jaw, and a frame in a face is changed into the color component value of a representation color. 
[0104] Each above mode changes the particular part of a photographic subject, and it is necessary to 
pinpoint the range for conversion in a high precision. With reference to drawing 13 , the details of the 
extract process of a photographic subject field and the image transformation process of a photographic 
subject portion are explained. 

[0105] A user sets up conversion photography mode with photography mode setting equipment 240 first 
(S41). An image including the photographic subject set as the object of conversion is photoed after 
conversion photography mode setting (S42), and automatic detection mode or manual setting mode is 
distinguished (S43). 

10106) In the case of manual setting mode (S43), the location where a photographic subject exists with the 
photographic subject extractor 236 using the directions selecting arrangement 226 etc. is specified (S44). 
For example, in using a pen type thing as a directions selecting arrangement 2269, it directs the point 
equivalent to the reference points (center of a face etc.) of the photographic subject of the input image 
displayed on the display display 224 with the pen. It is good also considering the location of the direction 
of a look which detects with a look detection means and is acquired as a reference point. 
[0107] in the case of automatic detection mode (S43), it is shown in ( drawing 14 - as -) - a control circuit 
222 reads auxiliary border line data from storage 220 or a record medium 230 (S45). Furthermore, the 
auxiliary border line 250 ( drawing 14 ) may be displayed on an input image in piles centering on a 
reference point location on the screen of the display display 224. This display action may be made to be 
started by pushing the carbon button 248 ( drawing 14 ) for an auxiliary outline display As mentioned 
above, this auxiliary border line is a border line of the face expressed with a closed curve etc., and shows 
the outline configuration of the field which should be changed etc. That is, it differs from the marker who 
only shows the target location. 

[0108] Corresponding to the set up photography conditions (especially a scale factor, the direction of a 
look, etc.), according to the fluctuation, a control circuit 222 is set up automatically and changes the size, 
location, or configuration of auxiliary border-line data (S46). In this case, the size A of a proper shall be 
beforehand given to the photographic subject as incidental information, and a control circuit 222 
calculates the auxiliary -data size on a screen from photography conditions, such as a scale factor and 



photographic subject distance (from whenever [ focus ] etc. to presumption) of an outline, changes it into 
suitable size, and is displayed on the display display 224 as a close border line. For example, in a focal 
distance, if distance from the second principal point location of A and image formation optical system to 
the image pick up side of an image sensor 214 is set [ the gap from the maximum of f and focus level ] to v 
for dp and the standard size of a photographic subject, the photographic subject size S on a screen will be 
given by the following formula, namely, - S=A(vf) U+(v-£) dp/0/f (2) 

However, suppose that fluctuation of photographic subject distance and fluctuation of focus signal level 
are linearity. 

[0109] Therefore, what is necessary is just to change the size of an auxiliary data by measuring dp and 
asking for f by lens location measurement etc. according to scale-factor S/A based on a formula (2). It 
cannot be overemphasized that photographic subject distance may be presumed with other means (for 
example, ranging means using a laser beam etc.). 

[0110] The photographic subject extractor 236 makes an auxiliary border line (or mask data as field data 
inside an auxiliary border line) an initial outline (initial field), sets it as the suitable location on an input 
image, and performs extract processing of a photographic subject field by making it into an initial data 
(S47). However, when manual setting mode is chosen, the set-up interior of an auxiliary border line is 
extracted as a photographic subject field. When for example, bloodshot-eyes amendment mode is set up as 
photography mode, the rectangle which includes the both eyes of the portrait image corresponding to the 
configuration border line model or standard photography distance of both eyes as an auxiliary border line, 
and has size comparable as the gap of both eyes is used. 

[0111] In this example, the method which made ** SU the dynamic outline method indicated by 
JP,9-185719,A by the same applicant as this application is used. A dynamic outline method is the method 
of completing it as the outline on a body by transforming a border-line model so that a border line model 
(initial outline : it is equivalent to an auxiliary border line in this example.) may be given and the energy 
performance index which meant as a constraint that it was on that an outline configuration is smooth and 
an edge etc. may serve as min. 

[0112] Since outline coincidence of an auxiliary border line and the border line of the photographic subject 
which should be extracted can be automatically carried out by changing the size about an auxiliary 
border line etc. based on image pick-up conditions, the photographic subject field by the complexity of the 
image pattern for a background and the complexity of a photographic subject configuration which should 
be changed ** can be extracted to a high speed and stability 

[0113] Thus, after extracting the field inside the border line (closed curve) obtained automatically as a 
photographic subject field, in a photographic subject field, T and binary mask data which are set to '0' 
except [ its ] are generated. Image transformation equipment 238 performs transform processing 
according to conversion photography mode to the image belonging to a mask field (for example, a mask 
value is the field of T) (S48). 

[0114] For example, when bloodshot-eyes amendment mode is set up as photography mode, 
bloodshot-eyes amendment processing is performed to the pixel of the red component of the extracted 
field. As shown in drawing 15 , it searches for the pixel which contains many red components which are 
specific colors in a mask field (S61), and, specifically, the connection field is extracted (S62). And it is a 
field contiguous to the connection field, a representation color component is extracted from the set of the 
pixel which is within the limits of planned color components, such as black or tea, (S63), and the color 
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component value of the corresponding pixel is changed into representation colors (black etc.) (S64). It is 
the pixel which does not define beforehand the color component value permitted as a representation color, 
but is near the corresponding pixel, and although it has the color component value of non-red and 
non- white, color component values (for example, brown, blue, or a golden component etc.) may be used. 
You may change uniformly so that it may have the color component value beforehand set up in the red 
component pixel in a mask field, without extracting a connection field. 

[0115] bloodshot-eyes amendment mode and silverfish - an example of the automatic processing (it 
corresponds to extract processing of the field which should be pinpointed by S47 of drawing 13 .) which 
can pinpoint the field for the transducer used in common with freckle removal mode, mustached removal 
mode, etc. is explained with reference to drawing 16 . Here, an auxiliary border line shall be given as a 
target border-line model which should be changed, and as mentioned above, based on image pick up 
conditions, such as a scale factor and photographic subject distance, a scaling shall be made beforehand. 
[0116] First, the point which corresponds as the focus of a border-line model to one of classification, such 
as the point of inflection, a corner, and the curvature maximum point, is extracted (S7l), and each 
classification and location are recorded. This data may be beforehand given as incidental data of a 
border-line model. 

[0117] The edge intensity distribution of an input image are searched for by filtering accompanied by 
space derivation, such as Sobel, Prewitt, or Canny, (S72). The acquired edge intensity distribution are 
made binary with a predetermined threshold, processing of the maximum location trace of thinning or 
edge intensity distribution etc. is added if needed, and border line data is extracted (S73). 
[0118] The focus (and the classification) is detected like model data from the extracted border line (S74), 
between the focus between both border lines data is matched (S75), and the location gap vector between 
corresponding points is extracted (S76). Since this location gap vector gives the relative displacement 
centering on a center of gravity, that amount of offset is made to serve as zero, and it normalizes (S76). 
[0119] The displacement corresponding to location gap vector quantity is given to each focus (S77), spline 
interpolation etc. generates the curve which connects between the focus adjoined after migration, and a 
border-line model is transformed (S78). 

[0120] It cannot be overemphasized that matching between curves is not limited to the method mentioned 
above, and other methods may be used. 

[0121] Thus, it is the pinpointed field which is obtained and where the field inside the border line (closed 
curve) of the border-line model which deformed is set as the object of image transformation. Furthermore, 
you may amend using other technique, such as a dynamic outline method, if needed. Desired image 
transformation is automatically performed to a photography image (output image of an image sensor 214) 
** [ according to / the complexity of the configuration of a portion to be changed etc. ] by above-mentioned 
matching processing and pinpointing of a deformation field. 

[0122] After above photographic subject field extracts and image transformation processings, a coding 
network 232 carries out compression coding of the image after conversion (S50), and records on a record 
medium 230 (S5l). The image output signal generating circuit 234 generates and outputs video signals 
(NTSC system or PAL system) from the image after conversion simultaneous in be fastidious (S52). 
[0123] In the graphics format outputted from a coding network 232, incidental information, such as image 
pick-up conditions, photography time, compressibility, and a compression method, is recorded on a header 
or the incidental information data file created separately by the existence of activation of image 



transformation, conversion photography mode, a conversion location, auxiliary border-line data, and the 
list if needed, for example. An example of the expression method about the record format of these items is 
shown in drawing 17 . 

[0124] Incidental information may record on an image that it cannot perceive visually as electronic 
watermark data (Proc of the IEEE, vol.83, pp. 944-957. 1995). For example, the least significant bit 
showing image data is assigned as a write-in bit of these data, and there are methods, such as embedding 
into the edge portion in an image. In this case, especially the border line for a transducer can be 
superimposed and recorded on image data. 

[0125] In this example, photographic subject image 242c used as the photographic subject 252 of drawing 
14 and the model for an extract does not necessarily need to be in agreement. It is because it can ask for 
the border line of a right photographic subject by a dynamic outline method etc. 

[0126] Although image transformation was performed to the extracted object domain in this example, it 
cannot be overemphasized that image transformation may be carried out to reverse at a part for the 
background. This is the same also about the following examples. 

[0127] With the configuration shown in drawing 12 , image pick up conditions, image data, a model 
border line, etc. may be supplied to the photographic subject extract circuit 236 after photography, image 
pick up conditions may be utilized, and image transformation which asked for and mentioned the 
conversion field above may be performed. In this case, image -processing section 210b separated from 
main part 210a is realizable by computer. The function of the photographic subject extract circuit 236 and 
the image transformation circuit 238 is realized by the program of the procedure shown in drawing 13 , 
drawing 15 , etc. 

[0128] Next, the example which performs geometric transform processing or substitute processing to the 
predetermined image portion set up or extracted by the method shown in the above-mentioned example to 
the input image is explained. The flow chart of an overall procedure is shown in drawing 18 . Drawing 18 
is the same as the processing flow fundamentally shown in drawing drawing 13 except for a setup in 
conversion photography mode. 

[0129] the target transform processing (S89 of drawing 18 ) be substitute processing to the parts image 
data by which each part be beforehand prepared for deformation of each part, such as processing which 
fatten or dwindle an image field about the parts (an arm, leg, etc.) of for example, hairstyle conversion, 
mustached addition conversion, facial form conversion, portrait-izing, a face, or the body or all the bodies, 
an eye which be the component of a face, a nose, and opening, or modification of the geometry between 
each part, and a list etc. 

[0130] In this example, the type which set up conversion photography mode (S8l), and set up that degree 
after that with the classification of conversion which was mentioned above, or was further subdivided of 
the same conversion categories is chosen (S82). 

[0131] The photographic subject field used as the candidate for conversion is extracted (S88), and 
transform processing which suits the configuration for conversion well is performed after that using the 
size of image pick up conditions or an extract field etc. (S89). 

[0132] A mustached addition translation mode is the so-called processing which carries out texture 
mapping (see the "ray-tracing" OhmSha ** written by Shin-ichi Takemura) about the image data of the 
preselected mustache in the predetermined location of the face in an image. An example of a selection 
screen mustached type when the conversion photography mode of mustached addition is set as drawing 



19 is shown. A list of the mustached image according to type is displayed, and a user chooses one of them 
using the directions selecting arrangement 240. For example, the frame which surrounds an image using 
a cross-joint key is moved, and a non-illustrated confirmation button is pushed and chosen. The input 
image is displayed on the subwindow at the lower right of a screen. If the 'following' carbon button 
displayed on a screen is pushed after choosing a mustached type, as shown in drawing 20 , a processing 
result will be displayed on a display. When a user pushes a confirmation button etc., finally conversion 
photography (the video signal of an resolution picture is outputted [ encoding an resolution picture and 
recording on a record medium ] to the exterior) is completed. The texture data of a mustached image is 
performed as mustached texture mapping is mapped by suitable size and a suitable location using the 
configuration of a formula (2) and an extract field. 

[0133] In a facial form translation mode, so-called morphing or substitute between the face image data 
which should serve as a face image in an input image and a target etc. is performed. Facial form 
conversion is automatically performed using the model which consists of a partial feature element 
indicated by JP,7-320086,A by the same applicant as this application by taking correspondence between 
each part articles (an eye, a nose, opening, etc.) of the face of an input image and a target image. In this 
case, as the above-mentioned example explained, after the face image of a target is changed into suitable 
size by the automatic scaling based on image pick-up conditions, processing of morphing, substitute, etc. 
is performed. 

[0134] the sketch model data (being the so-called --) of the face currently beforehand prepared in the 
portrait ized mode after detecting a face field Carry out an automatic scaling, as the template model was 
explained previously, and correspondence is taken between the edge intensity distribution of the face field 
of an input image, and the components of the face of a sketch model. Furthermore, the movement 
magnitude from the model data of the arrangement between components (each center-of- gravity location 
etc.) and the deformation of each part article are amplified to linearity or non-linearity, and the fixtures of 
a face are exaggerated. Thereby, the line drawing image of the portrait-ized face is generated. 
[0135] In the above transform processing, in order to detect the location of conversion object domains (face 
field etc.) The model border line data (face etc.) for conversion is inputted from storage the same with 
having explained with reference to drawing 13 or subsequent ones. What is necessary is to scan in an 
image what changed this into suitable size using image pick up conditions by the formula (2) etc., and 
just to ask for the location where a correlation value with the border line for which it asked from the edge 
intensity distribution of an input image serves as max (or maximum). 

[0136] An example of the processing flow which generalized pretreatment of these transform processing is 
shown in drawing 21 . A template model is changed into suitable size based on image pick up conditions 
(a scale factor, photographic subject distance, the direction of a look, etc.) (SlOl), and point of inflection, a 
corner, the curvature maximum point, etc. on the border-line data are extracted as the focus of a template 
model, or focus data is read from storage as incidental information on template model data (S102). The 
edge intensity distribution of an input image are extracted (S103), binary izing, a border-line extract, etc. 
are performed (S104), and the focus extracted with the template model and the same focus are searched 
for and extracted (S105). 

[0137] Between the focus is matched (S106). Thereby, between the components which constitute faces, 
such as an eye, a nose, and opening, can be matched. That is, since the center of gravity location and size 
on the image of a template model are beforehand set up appropriately based on image pick up conditions 



etc., they can search for and detect the focus which corresponds in the near range for every focus in an 
input image for every focus on each part articles (an eye, a nose, opening, etc.) in a template model. 
[0138] The location gap vector between corresponding points is extracted, and it normalizes on the basis 
of a center-of-gravity location (S107). Various image transformation is performed based on this result 
(S108). 

[0139] A face field makes it become thin (making it grow fat), and deformation processing of conversion 
object domains (face image field etc.) is explained to an example for processing. A face makes it become 
thin and processing is variable power conversion (affine transformation) to which longitudinal 
magnification sets lateral magnification to a (it is 0< a<l here) to 1 about the field inside a border line. It 
is made to grow fat and is set to a> 1 in processing. 

[0140] After the location (reference point locations, such as a center of gravity) of a face field is detected, it 
asks by the method of showing the border line in drawing 16 . A face dwindles drawing 22 and it shows an 
example before and behind conversion of processing. It is made to become thin and a crevice occurs 
between parts for the face worn thin and a background in conversion photography. The image data of this 
gap portion is the following, and is made and generated. That is, the color component value or texture 
pattern of image data for a background which adjoins each border line of the face field in the original 
image is extracted, and the color component value of the adjoining portion is given to the pixel of an 
applicable portion, or the texture pattern of an adjoining field is mapped. The image of the whole 
background is photoed beforehand and the corresponding background image may replace a gap portion. 
[0141] it is made to grow fat and a conversion object domain is **** in the background region of the 
original image data at processing at reverse what is necessary is just to interpolate the image data 
inside the border line of the field after conversion by the affine transformation image data of the original 
portion for conversion, although it becomes ****** 

[0142] When replacing by other face images as other transform processing While other target images 
changed into the template size set up as the image field for conversion was mentioned above replace A 
face dwindles fields, such as a gap portion (refer to drawing 22 (2)) produced when a configuration is not 
in agreement, and background-image data is inserted in them by extrapolation of texture mapping or a 
color component etc. like the case of processing. 

[0143] In performing portrait-ization, while being able to give and predetermined-maximum-amplify the 
rate of exaggeration showing the degree of exaggeration of the location gap vector between the extracted 
each part articles, it divides (inch-between), and transforms the border line data of the original template 
model by linearity extrapolation, such as law. For example, based on the template model which consists of 
a partial feature element indicated by JP,7-320086, A by the same applicant as this application, it asks for 
the new location of each focus of each partial feature element by linearity extrapolation, and the curve 
which ties smoothly the new partial feature element obtained as a result is generated. Thereby, the 
portrait ized face image is called for. 

[0144] It can save with the border line data of the object domain after also changing the original image 
data of the field used as the candidate for conversion on the occasion of coding and record of the image 
after conversion. Thereby, when required later, processors, such as a computer, can be used and the 
original image data can be restored easily. The partial image of the object domain before changing into a 
file separate from the image data file after conversion as the record gestalt may be recorded, or you may 
record on a part for the header unit of the image data file after conversion. In generating the partial 



image data file before conversion, it records the image data file name after changing into the header unit 
etc. 

[0145] The background image is photoed beforehand, the target field is extracted based on the difference 
of the background image and the input image containing the candidate for conversion, and it may be 
made to perform image transformation which a user specifies as the field. Here, image pick up equipment 
shall be used by the stock photography which is not fixed to a tripod etc., and makes it a prerequisite for a 
focus to differ from exposure conditions etc. in the time of background-image photography and the input 
image photography including a photographic subject, a pin and/or, processing becomes easier when 
exposure conditions are in agreement, 

[0146] The extract of an object domain and the flow chart of a transform-processing process are shown in 
a photography actuation list at drawing 23 . 

[0147] A background image is photoed (Sill), the image pick up conditions at this time are extracted 
(S125), and it memorizes to storage 220 etc. Conversion photography mode is set up (S112) and 
conversion targets (a hairstyle, a mustache type, facial form, etc.) and the degree of conversion are 
specified if needed (S113). A photographic subject image (input image in a previous example) is photoed 
(S114), the image pick-up conditions at this time are also extracted (S126), and it memorizes to storage 
220. 

[0148] Then, in order to extract the corresponding points between a background image and an input 
image (S115) and to remove the effect of stock photography therefore the rotation to produce, a parallel 
displacement, scale-factor fluctuation, etc., the geometric conversion parameter (affine transformation or 
transparent transformation parameter) of the background image in consideration of the difference among 
the image pick up conditions between corresponding-points extract data and an image is presumed and 
extracted (S116). By taking into consideration the difference among image pick up conditions, the 
incorrect correspondence in corresponding-points extract processing is removed, and geometric 
conversion in a high precision is enabled (Si 17). 

[0149] It asks for a gray-scale-conversion parameter in consideration of a difference of image pick-up 
conditions, such as a pixel value between corresponding points and exposure conditions, and the 
gradation of a background image is changed (S118). Specifically with reference to the pixel values 
between corresponding points (RGB each color component value etc.), the pixel value translation table 
from a background image to the corresponding points of an input image to each gradation in 0 to 255 level 
is presumed. In consideration of photography conditions (exposure conditions etc.), much more 
high degree of accuracy-ization can be attained by eliminating the pixel value data of incongruent 
corresponding points in the amount of fluctuation of image pick-up conditions clearly in that case. 
[0150] Thus, the difference of the background image and input image which were changed is taken, and a 
photographic subject field is extracted by processing of making it binary with a predetermined threshold 
(S119). Since future processings are the same as the case of drawing 13 , detailed explanation is omitted. 
[0151] 

[Effect of the Invention] As explained above, according to this invention, in a set photograph, a 
commemorative photo, or a catalog photograph, the natural synthetic image into which the person or 
body which does not exist on that occasion was put is set by the composition and the photography 
conditions of a site, and simple actuation generates it, and it can be recorded in a photography site. 
[0152] By using the auxiliary border line about a configuration, size, etc. of a photographic subject which 



were recorded beforehand, if it is the same background, photographic subject extract and synthetic image 
generation can be automatically performed only by using the image in an auxiliary border line. 
[0153] When removal of an unnecessary person or an unnecessary body is not depended on the complexity 
of the configuration, either but photos the image of only a background, it can remove easily and fitting for 
the background equivalent to the portion after removal can be performed by simple actuation. 
[0154] According to this invention, moreover, the main photographic subject image portion which has the 
configuration of arbitration in an image input means by using image pick up conditions at the time of an 
image pick-up (at the time of an image input) or the background-image portion except the main 
photographic subject Specify with a sufficient precision, without being influenced by an image pattern, 
lighting conditions, etc. of a background, the automatic (semi-automatic) conversion photography which 
performs conversion or processing processing of arbitration to an applicable portion is attained, and the 
image which performed such conversion can be recorded or transmitted. 

[0155] Moreover, since a model border line can be set as the suitable location in an image with reference 
to photography conditions, a high speed and the field of a portion which is automatic and serves as a 
candidate for conversion can be extracted from an image, and desired conversion photography can be 
performed. 



[Translation done.] 



* NOTICES * 

Japan Patent Office is not responsible for any 
damages caused by the use of this translation. 

l.This document has been translated by computer. So the translation may not reflect the original 
precisely. 

2 **** s hows the word which can not be translated. 
3. In the drawings, any words are not translated. 



DESCRIPTION OF DRAWINGS 



[Brief Description of the Drawings] 

f Drawing ll Outline configuration block drawing of the 1st example of this invention is shown. 
[Drawing 21 It is the flow chart of the extract of a photographic subject, and a synthetic process with a 
background image. 

[Drawing 31 The example of the display screen of the display display 24 is shown. 

f Drawin g 41 It is the synthetic example which detached and added a little same photographic subject 
image. 

[Drawing 5l It is another flow chart of synthetic processing of this example. 
[Drawing 61 It is another example of a screen of this example. 

[Drawing 7l It is outline configuration block drawing of the 2nd example of this invention. 
[Drawing 8l It is the operation flow chart of the example shown in drawing 7 . 

[Drawing 91 It is the example of a screen which enabled it to adjust gradation and/or a color tone by the 
manual. 

[Drawin g 101 It is an example of a screen possessing the auxiliary outline display carbon button 154. 
[Drawin g 111 It is outline configuration block drawing of the 3rd example of this invention. 
[Drawing 121 It is outline configuration block drawing of the example of modification of the 3rd example. 
[Drawing 131 It is the flow chart which shows the procedure of the conversion photography processing in 
the 3rd example. 

[Drawing 141 It is an example of the display screen in the 3rd example. 

[Drawing 15l It is the flow chart of the image transformation processing in the 3rd example. 

fDrawin g 161 It is the flow chart of the photographic subject field automatic extracting processing in the 

3rd example. 

[Drawing 171 It is the example of an expression of the image recording format in the 3rd example. 
[Drawin g 18l It is another flow chart of image transformation processing. 

[Drawing 191 The selection- menu display screen at the time of mustached addition conversion 
photography 

[Drawing 201 It is an example of an image after mustached addition conversion. 

[Drawing 2ll It is the flow chart of pretreatment of the image transformation shown in drawing 18 ■ 
[Drawing 22l It is made to become thin and is an example of the photographic subject image before and 
behind conversion of conversion photography. 

[Drawing 23l It is still more nearly another flow chart of image transformation processing. 



[Description of Notations] 

10: Image pick-up image processing system 

12' Image formation optical system 

14^ Image sensor 

16: Measurement control circuit 

18: Video signal processing circuit 

20: Storage 

22: Control signal generating circuit 

24: Display display 

26: Directions selecting arrangement 

28: Stroboscope luminescence equipment 

30: Record medium 

32: Image coding network 

34: Image output circuit 

36: Photographic subject extract circuit 

38: Image composition circuit 

40a, 40b, 40c: Photographic subject image display field 

42: Synthetic image display field 

44: Expansion carbon button 

46: Contraction carbon button 

48: Navigation key 

50a: Return key 

50b- Delivery key 

52: Auxiliary frame 

54: Rectangle frame 

140: Record medium 

142: Communications control circuit 

144: Image data format conversion circuit 

150: The slide bar for lightness conversion (or carbon button) 

152: The slide bar for saturation conversion (or carbon button) 

154: Auxiliary outline display carbon button 

156: Auxiliary border line 

158: The photographic subject image surrounded by the auxiliary border line 156 

210: Image pick-up image processing system 

210a: Main part 

210b: Image -processing section 

212: Image formation optical system 

214: Image sensor 

216: Measurement control circuit 

218: Video signal processing circuit 

220: Storage 

222: Control circuit 



224,224b: Display display 

226: Directions selecting arrangement 

228: Stroboscope luminescence equipment 

230: Record medium 

232: Image coding network 

234: Image output circuit 

236: Photographic subject extract circuit 

238: Image transformation circuit 

240: Photography mode setting equipment 

242a, 242b, 242c: The model for an extract 

244: Arrow key 

246: Delivery / return key 

248: The carbon button for an auxiliary outline display 
250: Auxiliary border line 
252: Photographic subject 



[Translation done.] 



